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^^ , Abstract 

(^ , The bin packing problem is to find the minimum number of bins of size one to pack a hst of 

items with sizes ai, . . . , a„ in (0, 1]. Using uniform sampling, which selects a random element 
-^^ from the input list each time, we develop a randomized Q(' "'. °g"^H °b °sn) _^/i\0{-)\ ^jjjjg (ij_^\_ 

approximation scheme for the bin packing problem. We show that every randomized algorithm 



o 



with uniform random sampling needs fl{^- ^n^ ) time to give an (1 + e)-approximation. For 



"^r I Willi UiiiiUiiii icliiUUiii tjcliiipiiiig iiKtiUS ,1 ^ I t ^n 

^SJ ' each function s{n) : N ^ N, define '^is{n)) to be the set of all bin packing problems with 

the sum of item sizes equal to s{n). For a constant b £ (0, 1), every problem in '^(n'') has 
[■~~. ' an 0(n^~' (log n) (log log n) + (-) ~ ) time (1 + e)-approximation for an arbitrary constant e. 

^^ I On the other hand, there is no o{n^^'') time (1 + e)-approximation scheme for the bin packing 

^^ . problems in '^{n^) for some constant e > 0. We show that '^{n^) is NP-hard for every 

b £ (0, 1]. This implies a dense sublinear time hierarchy of approximation schemes for a class of 
NP-hard problems, which are derived from the bin packing problem. We also show a randomized 
. , ■ streaming approximation scheme for the bin packing problem such that it needs only constant 

r> I updating time and constant space, and outputs an (1 + e)-approximation in (i)*-*'?' time. Let 

2 ■ S'((5)-bin packing be the class of bin packing problems with each input item of size at least 5. 

This research also gives a natural example of NP-hard problem (S(5)-bin packing) that has a 
constant time approximation scheme, and a constant time and space sliding window streaming 
approximation scheme, where 5 is a positive constant. 



1. Introduction 

The bin packing problem is to find the minimum number of bins of size one to pack a hst of items 
with sizes ai,. . . ,an in (0, 1]. It is a classical NP-hard problem and has been widely studied. The 
bin packing problem has many applications in the engineering and information sciences. Some 
approximation algorithm has been developed for bin packing problem: for examples, the first fit, 
best fit, sum-of-squares, or Gilmore-Gomory cuts [2j |8l [71 [TH [15] . The first linear time approximation 
scheme is shown in [11]. Recently, a sublinear time 0{\/n) with weighted sampling and a sublinear 
time 0(71^'^) with a combination of weighted and uniform samplings were shown for bin packing 
problem l^. 

We study the bin packing problem in randomized offline sublinear time model, randomized 
streaming model, and randomized sliding window streaming model. We also study the bin packing 
problem that has input item sizes to be random numbers in [0, 1]. Sublinear time algorithms have 
been found for many computational problems, such as checking polygon intersections |S], estimating 
the cost of a minimum spanning tree |SJ [HI \I^, finding geometric separators [13], and property 
testing [5^ [T7], etc. Early research on streaming algorithms dealt with simple statistics of the 
input data streams, such as the median j21) . the number of distinct elements |12| . or frequency 
moments [1]. Streaming algorithm is becoming more and more important due to the development 
of internet, which brings a lot of applications. There are many streaming algorithms that have been 
proposed from the areas of computational theory, database, and networking, etc. 

Due to the important role of bin packing problem in the development of algorithm design and 
its application in many other fields, it is essential to study the bin packing problem in these natural 
models. Our offline approximation scheme is based on the uniform sampling, which selects a ran- 
dom element from the input list each time. Our first approach is to approximate the bin packing 
problem with a small number of samples under uniform sampling. We identify that the complexity 
of approximation for the bin packing problem inversely depends on the sum of the sizes of input 
items. 

Using uniform sampling, we develop a randomized 0{ "^i °^ °^" + (7)*^^"'') time (1 + e)- 

approximation scheme for the bin packing problem. We show that every randomized algorithm with 
uniform random sampling needs ri(Y^^? — ) time to give an (1 + e)-approximation. Based on an 

adaptive random sampling method developed in this paper, our algorithm automatically detects an 
approximation to the weights of summation of the input items in time 0{ °^n °^ °^ " ) time, and 

then yields an (1 + e)-approximation. 

For each function s{n) : N ~^ N, define X) (*("-)) ^^ be the set of all bin packing problems with 
the sum of item sizes equal to s{n). For a constant b G (0,1), every problem in '^{n ) has an 
0(n^~''(logn)(loglogn) + (-)'^'-~-') time (1 + e)-approximation for an arbitrary constant e. On the 
other hand, there is no o{n^^^) time (1 + e)-approximation scheme for the bin packing problems in 
J2{^'') foi' some constant e > 0. We show that X]("-'') is NP-hard for every b € (0, 1]. This implies a 
dense sublinear time hierarchy of approximation schemes for a class of NP-hard problems that are 
derived from bin packing problem. We also show a randomized single pass streaming approximation 
scheme for the bin packing problem such that it needs only constant updating time and constant 
space, and outputs an (1 + e)-approximation in (i)'^^?) time. This research also gives an natural 
example of NP-hard problem that has a constant time approximation scheme, and a constant time 
and space sliding window single pass streaming approximation scheme. 

The streaming algorithms in this paper for bin packing problem only approximate the minimum 
number of bins to pack those input items. It also gives a packing plan that allows an item position to 
be changed at different moment. This has no contradiction with the existing lower bound [4] [19] that 
no approximation scheme exists for online algorithm that does not change bins of already packed 
items. 

A more general model of bin packing is studied in this paper. Given a list of items in (0, 1], 
allocate them to several kinds of bins with variant sizes and weights. We want to minimize the total 



costs X]?:=i '^i''^ii where Ui is the number of bins of size si and cost Wi. 

In scction[21 we give a description of computational models used in this paper. A brief description 
of our methods arc also presented. In section [31 we show an adaptive random sampling method for 
the bin packing problem. In section [51 we present randomized algorithms and their lower bound 
for offline bin packing problem. In section [51 we show a streaming approximation scheme for bin 
packing problem. In section [9l we show a sliding window streaming approximation scheme for bin 
packing problem with each input item of size at least a positive constant i5. The main result of this 
paper is stated in Theorem 1101 

2. Models of Computation and Overview of Methods 

Algorithms for bin packing problem in this paper are under four models, which are deterministic, 
randomized, streaming, and sliding windows streaming models. 

Definition 1. 



• 



• 



A hin packing is an allocation of the input items of sizes ai, . . . ,a„ in (0, 1] to bins of size 
1. We want to minimize the total number of bins. We often use Opt{L) to denote the least 
number bins for packing items in L. 

Assume that c and 77 are constants in (0, 1), and fc is a constant integer. There are k kinds of 
bins of different sizes. If c < si < 1, and rj < Wi < 1 for all i := 1, 2, . . . , fc, then we call the k 
kinds of bins to be (c,ri,k) -related, where Wi and Si arc the cost and size of the i-th kind of 
bin, respectively. 

A bin packing with [c,ij,k) -related bins is to allocate the input items ai,...,a„ in (0,1] to 
(c, 77, fc)-related bins. We want to minimize the total costs X)i=i '^j^ii where Ui is the number 
of bins of cost Wi. We often use Optc,rj,k{L) to denote the least cost for packing items in L 
with (c, 77, fc)-related bins. It is easy to see Opt{L) = Opti.i_i(L). 

For a positive constant S, a S'((5)-bin packing problem is the bin packing problem with all input 
items at least 6. 

• For a nondecreasing function f{n) : A^ — > iV, a ^{f in))-hm packing problem is the bin packing 
problem with all input items ai, . . . , a„ satisfying X]i=i ^i ~ /(")■ 

Deterministic Model: The bin packing problem under the deterministic model has been well 
studied. We give a generalized version of bin packing problem that allows multiple sizes of bins to 
pack them. It is called as bin packing with (c, 77, fc) related bins in Definition [H It is presented in 
Section [3 

Randomized Models: Our main model of computation is based on the uniform random sam- 
pling. We give the definitions for both uniform and weighted random samplings below. 

Definition 2. Assume that ai, . . . , a„ is an input list of items in (0, 1] for a bin packing problem. 

• A uniform sampling selects an element a from the input list with Pr[a ~ ai] = — for 7 = 1, . . . , ?^. 



• 
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A weighted sampling selects an element a from the input list with Pr[a = ai] = ^n' — for 



We feel that the uniform sampling is more practical to implement than weighted sampling. In 
this paper, our offline randomized algorithms are based on uniform sampling. The weighted sampling 
was used in [5] . The description of our offline algorithm with uniform random sampling is given in 
Section [51 

Streaming Computation: A data stream is an ordered sequence of data items pi,p2, ■ ■ ■ ,Pn- 
Here, ti denotes the number of data points in the stream. A streaming algorithm is an algorithm 



that computes some function over a data stream and has the following properties: 1. The input 
data are accessed in the sequential order of the data stream. 2. The order of the data items in the 
stream is not controlled by the algorithm. Our algorithm for this model is presented in Section |S1 

Sliding Window Model: In the sliding window streaming model, there is a window size ?7 for 
the most recent n items. The bin packing problem for the sliding window streaming algorithm is to 
pack the most recent n items. Our algorithm for this model is presented in Section [9l 

Bin Packing with Random Inputs: We study the bin packing problem such that the input 
is a series of sizes that are random numbers in [0, 1]. It has a constant time approximation scheme 
and will be presented in Section [9. II 

2.1. Overview of Our Method 

We develop algorithms for the bin packing problem under offline uniform random sampling model, 
the streaming computation model, and sliding window streaming model (only for S'((5)-bin packing 
with a positive constant 5). The brief ideas are given below. 

2.1.1. Sublinear Time Algorithm for Offline Bin Packing 

Since the sum of input item sizes is not a part of input, it needs 0{n) time to compute its exact 
value, and it's unlikely to be approximated via one round random sampling in a sublinear time. 
We first approximate the sum of sizes of items through a multi-phase adaptive random sampling. 
Select a constant ip to be the threshold for large items. Select a small constant 7 = 0(e). All 
the items from the input are partitioned into intervals [tti, ttq], (7r2, tti] . . . , [iTi+i, tt^], . . . such that 
ttq = 1, TTi = (p, and tTj+i = 7r,;/(l + 7) for i = 2, . . .. We approximate the number of items in each 
interval (Tr^+i, tt^] via uniform random sampling. Those intervals with very a small number of items 
will be dropped. This does not affect much of the ratio of approximation. One of worst cases is 
that all small items are of size -^ and all large size items are of size 1. In this case, we need to 
sample ^{ '^ " ) number of items to approximate the number of Is. This makes the total time 

to be ^{-^-^ ). Packing the items of large size is adapted the method in [TT], which uses a linear 

programming method to pack the set of all large items, and fills small items into those bins with 
large items to waste only a small piece of space for each bin. Then the small items are put into bins 
that still have space left after packing large items. When the sum of all item sizes is 0(1), we need 
0{n) time. Thus, the 0{n) time algorithm is a part of our algorithm for the case X]r=i ^i ~ 0{1). 

2.1.2. Streaming Algorithm for Bin Packing 

We apply the above approximation scheme to construct a single pass streaming algorithm for bin 
packing problem. A crucial step is to sample some random elements among those input items of size 
at least S, which is set according to e. The weights of small items are added to a variable si. After 
packing large items of size at least S, we pack small items into those bins so that each bin does not 
waste more than 5 space while there is small items unpacked. 

2.1.3. Sliding Window Streaming Algorithm for S'((5)-Bin Packing 

Our sliding window single pass streaming algorithm deals with the bin packing problem that all 
input items are of size at least a constant S. Let n be the size of sliding window instead of the total 
number of input items. Select a sufficiently large constant k. There are k sessions to approximate 
the bin packing. After receiving every ^ items, a new session is started to approximate the bin 
packing. The approximation ratio is guaranteed via ignoring at most ^ items. As each item is of 
large size at least 5, ignoring ? items only affect a small ratio of approximation. 



2.1.4. Chernoff Bounds 

The analysis of our randomized algorithm often use the well known Chernoff bounds, which are 
described below. All proofs of this paper are self-contained except the following famous theorems in 
probability theory and the existence of a polynomial time algorithm for linear programming. 

Theorem 3 ( |20| ). Let Xi, . . . ,X„ be n independent random 0-1 variables, where Xi takes 1 with 
probability pi. Let X = X]i=i -^i' '^"■'^ /^ ^ ^[^]- Then for any S > 0, 

I. Pi{X < (1 - S)n) < e-i^'^\ and 
it. Pt{X > (1 + 6)fi) < 



We follow the proof of Theorem [3] to make the following versions (Theorem [5l Theorem HI and 
Corollary [5]) of Chernoff bound for our algorithm analysis. 

Theorem 4. Let Xi, . . . ,X„ be n independent random 0-1 variables, where Xi takes 1 with prob- 
ability at least p for i = l,...,n. Let X ~ ^i=i-^ij 0,^^, fi = E[X]. Then for any 6 > 0, 
Pt{X < (1 - S)pn) < e-^*'P". 

Theorem 5. Let Xi, . . . ,X„ be n independent random 0-1 variables, where Xi takes 1 with prob- 
ability at most p for i = 1, . . . , n. Let X = J27=i -^i- Then for any S > 0, Pt{X > (1 + 6)pn) < 



(i+5)(i+i) 

Define gi{S) = e^^^' and g2{S) = tytwt+it- Define g{5) ~ ma,x{gi{6),g2{S)). We note that 
gi{S) and g2{S) are always strictly less than 1 for all (5 > 0. It is trivial for gi{S). For ,92 ((5), this can 
be verified by checking that the function f{x) = {1 -\- x) ln(l -|- x) — x is increasing and /(O) = 0. 
This is because f'{x) = ln(l -I- x) which is strictly greater than for all x > 0. 

Corollary 6 ( [18] ). Let Xi, . . . ,Xn be n independent random 0-1 variables and X = X]i;=i -^t- 
i. If Xi takes 1 with probability at most p for i = 1,. . . ,n, then for any ^ > e > 0, Pr{X > 

pn + en) < e~3"' . 

ii. If Xi takes 1 with probability at least p for i ~ 1, . . . ,n, then for any e > 0, Pt{X < pn — en) < 



A well known fact in probability theory is the inequality 

Pr{Ei U ^2 . . . U E„,) < Pr(^i) + Pr(£;2) + ■ • • + Pt{E^), 

where Ei, E2t ■ ■ , Em are m events that may not be independent. In the analysis of our randomized 
algorithm, there are multiple events such that the failure from any of them may fail the entire 
algorithm. We often characterize the failure probability of each of those events, and use the above 
inequality to show that the whole algorithm has a small chance to fail after showing that each of 
them has a small chance to fail. 

3. Adaptive Random Sampling for Bin Packing 

In this section, we develop an adaptive random sampling method to get the rough information for 
a list of items for the bin packing problem. We show a randomized algorithm to approximate the 
sum of the sizes of input items in 0((-^^# ) (log n) log log n)) time. This is the core step of our 

randomized algorithm, and is also or main technical contribution. 
Definition 7. 
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For each interval / and a list of items S, define C{I, S) to be the number of items of S in /. 

For (p,5, and 7 in (0,1), a {ip^ 5,^) -partition for (0,1] divides the interval (0,1] into intervals 
Ii = [7ri,7ro],/2 = (7r2,7ri],/3 = (TTg, tts], . . . , 4 = (0,7rfe_i] sueh that ttq = l,7ri = ip^-Ki = 
7ri_i(l — 5) for i = 2, . . . , fc — 1, and -Kk-i is the first element iik-i < -?■ 

For a set ^, |A| is the number of elements in A. For a list 5 of items, \S\ is the number of 
items in S. 



Lemma 8. For parameters (p,6, and 7 in (0,1), a [if, 6, j) -partition for (0,1] has the number of 
intervals k < — ^^|^ . 

Proof: The number of intervals k is the least integer with (5(1 — S)'^ < (1 — <5)'^ < ^. We have 

, '°S^ 2 1og« I 

'^ - log(l-<5) - 7<5 ■ ■ 

We need to approximate the number of large items, the total sum of the sizes of items, and the 
total sum of the sizes of small items. For a {(p, S, 7)-partition Ii U I2 ■ ■ ■ U Ik for (0, 1], Algorithm 
Approximate-Intervals(.) below gives the estimation for the number of items in each Ij if interval 
Ij has a number items to be large enough. Otherwise, those items in Ij can be ignored without 
affecting much of the approximation ratio. We have an adaptive way to do random samplings in a 
series of phases. Phase i + 1 doubles the number of random samples of phase t {mt+i = 2mt). For 
each phase, if an interval Ij shows sufficient number of items from the random samples, the number 
of items C{Ij,S) in Ij can be sufficiently approximated by C{Ij, S). Thus, C{Ij,S)'Kj also gives an 
approximation for the sum of the sizes of items in Ij. The sum appw ~ X)/ ^(^ji ^)''^j f'^'' those 
intervals Ij with large number of samples gives an approximation for the total sum X]i=i '^i of items 
in the input list. Let mt denote the number of random samples in phase t. In the early stages, 
appw is much smaller than -^. Eventually, appw will surpass -^. This happens when mt is more 
than r-^„" and app^ is close to the sum T^"!, a; of all items from the input list. This indicates 

> a, — '' — ^ 

that the number of random samples is sufficient for approximation algorithm. For those intervals 
with small number of samples, their items only need small fraction of bins to be packed. This 
process is terminated when ignoring all those intervals with none or small number of samples does 
not affect much of the accuracy of approximation. The algorithm gives up the process of random 
sampling when mt surpasses n, and switches to use a deterministic way to access the input list, 
which happens when the total sum of the sizes of input items is 0(1). The lengthy analysis is caused 
by the multi-phases adaptive random samplings. We show two examples below. 

Example 1: The input is a list of items such that there are three items of size 1, and the rest 
n — 3 items are of size 0.1 for a large integer n. Assume that e is a positive constant to control the 
accuracy of approximation. After sampling a constant -^ number of items, we observe all samples 
equal to 0.1 (with high probability). Thus, there are less than |^ items of size other than 0.1 with 
high probability by Chernoff bounds. We derive the approximate sum of total item sizes is O.ln, 
and output „ J''^ for the number bins for packing the input items, where the denominator 0.9 is 
based on the consideration that some bins for packing items of size 0.1 may waste up to 0.1 space. 
Although, there are small number of items of size 1, just ignoring those items of size 1 loses only a 
small accuracy of approximation. Therefore, the random sampling stops after sampling only O(-) 
items. We output an (1 + e)-approximation for the bin packing problem. 

Example 2: The input is a list of items such that there are three items are of size 1, and the 
rest n — i items are of size — j- for a large integer n. The number of random samples is doubled from 
one phase to next phase. After sampling rP"^ items, in which there is no large items of size 1 with 
high probability, we still feel that those items of large size will greatly affect the total number bins. 
We have to continue use more random samples. Eventually, the number of random samples mt is 
more than n. Thus, we switch to use a deterministic 0(n) time algorithm to compute the number 
of large items, the total sum of the sizes of items, and the total sum of the sizes of small items. 



Algorithm Approximate- Intervals (99, S, 7, 9, a, P, n, S) 

Input: a parameter (p £ (0, 1), a small parameter 6 G (0, 1), a failure probability upper bound 
a, a {(fi, S, 7) partition P = IiU . . .U Ik for (0, 1] with (5, 7 G (0, 1), an integer n, a list S of n items 
ai, . . . , a„ in (0, 1]. Parameters if, S, 7, 0, and a do not depend on the number of items n. 

Steps: 

1. Phase 0: 

2. Let z :— ^0 log log n, where ^0 is a parameter such that 8(A: + 1) {log n)g (9)^^^ < a for all 
large n. 

3. Let parameters Co := yoo,C2 := 3(1+5]^, C3 := 5(1+57' ^4 '^ (i-s)(i-S}<pco' ^'^'^'^^ •" (i^e)c2C3- 

4. Let rriQ := z. 

5. End of Phase 0. 

6. Phase t: 

7. Let mt '■— 2?7it_i. 

8. Sample mt random items 0,;^ , . . . , a^^ from the input list S. 

9. Let dj :~ \{j : ai, G Ij and 1 < j < mt}\ for j ~ 1,2, . . . ,k. 

10. For each Ij, 

11. if dj > z, 

12. then let (7(1^, S) :~ -^dj to approximate C{Ij,S). 

13. else let C'(/j,S') :=0. 

14. Let appju := J2d >z ^(^' '^)'''j *o approximate X]"=i '^'t- 
is. If app^, < '''"^°^,'°^" and m* < n then enter Phase i + 1. 

16. else 

17. If 77i( < n 

18. then let app^ := 2^^.>^ „„^ j.>i (7(7^, 5)7rj to approximate Ea.<5a<»<n ««■ 



19. else let app^, := 1]"=! Oi and app'^ := X^a 



<v 



a,;. 



20. Output appw, app'^ and C(/i, S') (the approximate number of items of size at least Lp). 

21. End of Phase i. 

End of Algorithm 

Lemma [5] uses several parameters ip,5,^,a and 9 that will be determined by the approximation 
ratio for the the bin packing problem. If the approximation ratio is fixed, they all become constants. 

Lemma 9. Assume that Lp, 5, 7, a and 9 are parameters in (0, 1), and those parameters do not depend 
on the number of items n.. Then there exists a randomized algorithm described in Approximate- 
Intervals(.) such that given a list S oj items of size ai,...,a„ in the range (0,1] and a {ip,S,j)- 
partition for (0, 1], with probability at most a, at least one of the following statements is false after 
executing the algorithm: 



1. For each Ij with C{Ij,S) > 0, C{Ij,S){l - 6) < C{Ij, S) < C{Ij,S){l + 9); 

^- Z^a.elj and C{Ij,S)=0°'i - T'^i=l °'«) + n' 

3. (1 - 6){l - 6)^{^^ - ^) < app^ < (1 + 0)(ELi «,); 

I If 111=1 a^ > 4, then i(l - 0)(1 - S)ip{Z"=i «0 < <^PPn, < (1 + 0){j:ti «0; «"rf 

5. It runs in 0{jY:^gYW\o — TW) ^^^^^^{ v^"" j '^) (log f^) log log n) fiTTie. In particular, the complexity of 

i/ie algorithm is 0(min( Y^„" , n)(logn) loglogn) if if, d,^, a and 9 are constants in (0, 1). 

Lemma ini implies that with probability at least 1 — a, all statements [T] to [5] are true. Due to the 
technical reason described at the end of section 12.1.21 we estimate the failure probability instead of 
the success probability. 

Proof: Let ^pj cq, C2, C3, C4, and C5 be parameters defined as those in the algorithm Approximate- 
Intervals(.). We use the uniform random sampling to approximate the number of items in each 
interval Ij in the ((^, 5, 7)-partition. 

Claim [oil. Let Qi be the probability that the following statement is false: 

(i) For each interval Ij with dj > 2, (1 - 9)C{Ij,S) < C{Ij,S) < (1 + 9)C{Ij,S). 

Then for each phase in the algorithm, Qi < (fc + 1) • g{9)^ ■ 
Proof: Let pj = n ■ ^'^ element of S in Ij is sampled (by an uniform sampling) with 
probability pj. Let p' = ^r~- ^^or each interval /_, with dj > z, we discuss two cases. 

• Case 1 . p' > Pj. 

In this case, dj > z > 2p'mt > 2pjmt. Note that dj is the number of elements in interval Ij 
among mt random samples a^j , . . . , a^^^ from S. By Theorem [5] (with 9 = 1), with probability 

at most Pi ~ 52(1)^™' < 52(1)^^^ < 5(l)^^^j there are at least 2pjmt samples are in from 
interval Ij. 

• Case 2. p' < pj. 

By TheoremEl we have Pr[dj > (1 + 9)pjm.t] < 52(6*)^^"" < 32(0)^'™* < 52(6*)* < g{9)i . 
By TheoremU we have Pr[dj < (1 - 9)pjmt] < .gi(6')w™' < gi(6')P'™* = gi{d)^ < 9{0)^ . 
For each interval Ij with dj > z and (1 — 6)pjmt < dj < (1 + 9)pjmt , we have (1 — 9)C{Ij , S) < 
C{Ij,S) < (1 + 9)C{Ij,S) by line[n]in Approximate-Intervals(.). 

There are k = (log n) intervals Ii, . . . , Ik- Therefore, with probability at most P2 ~ k-g{6) 2 , the 
following is false: For each interval Ij with dj > z, (l-6')C(/j, S") < C{Ij,S) < {l + e)C{I-i,S). 

By the analysis of Case 1 and Case 2, we have Qi < Pi + P2 < (k + 1) ■ g{9)^ . Thus, the claim 
has been proven. I 

Claim[9l2. Assume that mt > g^csn^ogiogn ^ Then right after executing Phase t in Approximate- 

Intervals(.), with probability at most Q2 = 2fcg(6')^°'°s'°s", the following statement is false: 

(ii) For each interval I^ with C{Ij,S) > cgELia*' A). (1 - 9)C{Ij,S) < C{Ij,S) < (1 + 
e)C{Ij,S); andB). dj > z. 
Proof: Assume that m* > '^2C5«^ogioKn ^ Consider each interval Ij with C{Ij,S) > C3j27=iai- 

We have that pj = ^' > — '=^ . An element of S in Ij is sampled with probability pj . By 
Theorem [5] and Theorem |4l we have 

Pr[dj < (1 - e)pj77lt] < gi{9Y="'' < gi(6»)'=^^3C5loglog„ < ^^(g,^)Cologlogn^ ^j^ 

Pr[dj > (1 + e)pj77it] < g2{9Y'"'* < 32(6')"'"'"' '°*^'°*^" < g{9)^" '°si°8". (2) 



Therefore, with probabihty at most 2kg (8)^°^°^^°^''^, the foUowing statement is false: 

For each interval /j with C{Ij,S) > cg YlLi «»>(!- ^)C{Ij^S) < C{Ij,S) < (1 + 9)0(1 j,S). 

If dj > (1 — 9)pjmt, then we have 

d- > (i_0)£i£ii^^^ 

n 
^ n m(^3 5i;r=i«0 cacgn log log n 

= (1 - 6')c2C3C5l0glogn 

> ^ologlogn = z. 

I 

Claim [9l3. The total sum of the sizes of items in those IjS with C{Ij,S) < C3 ^"^-^ a^ is at 

most ^{J2'■=l(^^) + i■ 
Prooi: By definition [71 we have Uj = (p{l — Sy^^ ioT j ~ 1, . . . ,k — 1. We have that 

• the sum of sizes of items in L. is at most 71^ = —, 

• for each interval Ij with C(Ij,S) < cg^j^j^a^, the sum of sizes of items in Ij is at most 
(c3 Tn=i ai)aj-i < (c3 J2"=i ai)(p{l - Sy-'^ for j e (1, k), and 

• the sum of sizes in /i is at most C3 X]i=i '^i- 

The total sum of the sizes of items in those IjS with C{Ij, S) < C3 X]i=i "^j i*^ ^^ most (03 X]i=i "^i) + 

Claim [9l4. Assume that at the end of phase t, for each Ij with C{Ij,S) > 0, C(/j, S')(l - &) < 
C{Ij,S) < C{I,,Syi + 0y,anddj >ziiC(Ij,S) > C3Er=i«- Then(l-0)(l-,5)<^(^-^-22) < 
o-PPw < (1 + ^)(X)i=i ^«) ^t t'^'^ ^^'^ ^^ phase t. 

Proof: By the assumption of the claim, we have appw = J2d >z ^(-^j' '^)^i — (1 + ^) X]"=i '^i- 
For each interval /j with j ^ k and j > 1, we have C{Ij, S)ttj > (1 — 5) J2a ei '^i ^^ ^■'^^ definition 
of ((y9, (5, 7)-partition. It is easy to see that C(/i,S')7ri > (fij^a-ei ^i ^y the definition of ((^,(5,7)- 
partition. Thus, 

CiIj,S)'Kj > (1 - 6)ip Y^ a, for j ^ k. (3) 

ai£lj 

We have the following inequalities: 

o-PPw = /_. ^{Ij^S)'Kj (bv linefTSlin Approximate- Intervalsf.)) 

dj ^z^j^k 

> {l-e){l-6)ip Y \ J2 ^'] (by inequality ©) 

n 

^—1 ^j <-2 a-i^Ij ai^Ik 



,6^ 



> {l^e){l-SMY^a,~i-{Y,a.O + ^)^n--L) (by Claim El 3) 



i=l 



2 n 
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Claim [9l5. With probability at most Q,5 = (fc + 1) • {\ogn)g{9) 2 , the following facts arc not all 
true: 

A. For each phase t with rut < 2g2C5»jog^iogn ^ ^^^ condition appy, < "^"^^°fj°^" in hne [H] of the 

algorithm is true. 

B- If ELi «« ^ 4, then the algorithm stops before rrit > 2c4C5«^iog^iogn ^ 

C. If X)i=i '^i — 4j then it stops before or at phase t in which the condition rrit > n first becomes 
true. 

Proof: By Claim [5]1, with probability at most (A: + 1) • g{d)^ , the statement i of Claim 1211 is 
false for a fixed m. The number of phases is at most log?i since mt is double at each phase. With 
probability (fc + 1) • (logn) ■ g{9)^ , the statement i of ClaimlHll is false for each phase t with mt < n. 
Assume that statement i of Claim [9ll is true for all phases t with mt < n. 

Statement H Assume that m, < 2-^^^">l°^^ We have ;^ > ..,.,„'L..o.„ = ^Si^' 

Therefore, ^=1 «. < (;^)2c2C5 log logn = ^ccn^ogiogn ^ g^ Claim [114, app^ < (1 + 0) Er=i «- 
Since (1 + 6*) < 2^7" (^^ line|3lin Approximate-Intervals(.)), we have 

//i,fl\V^ , 1 v^ ^ 1 2c2C5ri, log logn csn log logn 

^ 2c2Co ^ 2c2Co mt com* 

?— 1 i— 1 

Statement E The variable mt is doubled in each new phase. Assume that the algorithm enters 
phase t with °4C5niogiog» < ^ < 2c4Cg«iQgiog» _ ^ ^ j^ < ^^^^„" . „ = ^f',"' . Since 

^ > a,- — I — Y^" ^ mt — C4g5"'°g'°g" C4C5 log logn 

Er=i«^ > 4, (^^ - ^) > ^^. By Claim 14, app^ is at least ^^"'^^^"'^^ ELi «»■ Since 
( - )^ - )y > 7^, we have appw > '^°"c°m°^" ' '^hich makes the condition at lineHniin Approximate- 
Intervals(.) be false. Thus, the algorithm stops at some stage t with m,t < '^■a^^og ogw ^^ ^j^^ setting 

at line [15] in Approximate-Intervals(.). 

Statement \G\ It follows from statement A and the setting in line [15] of the algorithm. I 

Claini[9l6. The complexity of the algorithm is 0{ ,^_gsg}^^ — vjt min('^^Tr^ , n)(logn) log logn). 

In particular, the complexity is 0(min('^^7r^ , n) (log n) log log n) ii(p,S,j,a and 9 are constants in 

(0,1). 

Proof: By the setting in line [3] in Approximate-Intervals(.), we have 

1 12^0 

C2C5 



3(1 + S)C0 (1 - 9)C2C3 

4^0 



24Co(l + <5) 
{1~9)S^ ■ 
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In order to satisfy the condition 8{k+l){\ogn)g{9)^^'^ < a for all large n at line[2]in Approximate- 
Intervals (.), we can let Co = TS^JWj- 

Since mt is doubled every phase, the total number of phases is at most log n. The computational 
time complexity in statement [5] of the algorithm follows from Claim |9l5. I 

As mt is doubled each new phase in Approximate-Intervals (.), the number of phases is at most 
logn. With probability at most (logn)(Qi -|- Q2) + Q5 < a (by line[l]in Approximate-Intervals(.)), 
at least one of the statements (i) in Claim|9ll, (ii) in Claim[9l2, A, B, C in Claim[9]5 is false. 

Assume that the statements (i) in Claim[9]l, (ii) in Claim[9l2, A, B, and C in Claim|9l5 are all 
true. 

For an interval /j , C{Ij,S) > if and only if d^ > z by lines [TU] to [T2] in Approximate-Intervals (.). 
Therefore, statement 1 of the lemma follows from Claim [Sjl. 

If Approximate-Intervals (.) stops at nit < n, then rat > 2c2^t^og ogn |^y statement A in Claim 

ini5. For each interval Ij with C{Ij,S) > caX^ILi'^i' ^^ have dj > z, which implies C{Ij,S) > 0. 
Statement [2] of Lemma [9] follows from Claim |9l3 and statement (ii) of Claim |9l2. 

Statement [3] follows from Claim [9l4. The condition of Statement |4] implies n > 4. Statement |4] 
follows from Statement |31 Statement [S] for the running time follows from Claim [S]6. 

Thus, with probability at most a, at least one of the statements [T] to [5] is false. I 



4. Main Results 

We list the main results that we achieve in this paper. The proof of Theorem [TO] is shown in 
Section [ 



Theorem 10 (Main). Approximate- Bin- Packing(.) is a randomized approximation scheme for the 
bin packing problem such that given an arbitrary r G (0, 1) and a list of items S* = ai, . . . , a„ m (0, 1] 
for the bin packing problem, it gives an approximation app with Opt{S) < app < (1 -|- T)Opt{S) -\- 1 
^^ O( "(i°s")(iogj°g») + (i)O(i)) ^j^g ^^th probability at least ^ 



4- 



We show a lower bound for those bin packing problems with bounded sum of sizes X]i=i ^i- The 
lower bound always matches the upper bound. 

Theorem 11. Assume f{n) is a nondecreasing unbounded function from N to N with f{n) ^ o{n). 
Every randomized (2— e) approximation algorithm for bin packing problems in X](./(^)) needs n{jT^) 
time, where e is an arbitrary small constant in (0, 1). 

Proof: Since /(n) is unbounded, assume n is large enough such that 

(/(n)+2)(2-e)<2(/(n)~2). (4) 

We design two input list of items. 

The first list contains m = 2(/(n) — 2)) elements of size \ -\~ 5, where 5 = 2(f(n')-2) • ^^^ I'^st 
n — m items are of the same size 7 = ^^^^^ ~ o(l). We have rn{^ -\- S) -\- {n — m)^ = 2(/(n) — 2)(i -|- 
2(f(ra')-2i ) + 1 ^ ./('^)- Therefore, the first list is a bin packing problem is in X](/('^))- 

The second list contains n — f{n) elements of size 7 and the rest f{n) items are of size equal to 
1 — r, where r = /(„) ~ o(l). We have f{n){l — r) + (n — f{n))j = fin). The second list is 
also a bin packing problem is in '^{f{n)). 

Both 7 and t are small. Packing the first list needs at least 2{f{n) — 2) bins. Packing the second 
list only needs at most f{n) + 2 bins since two bins of size one is enough to pack those items of size 

T. 

Assume that an algorithm only has computational time o(-tt^) for computing (2 — e)- 
approximation for bin packing problems in '^{f{n)). The algorithm has an o(l) probability to 
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access at least one item of size at least i in both lists. Therefore, the two lists have the same output 
for approximation by the same randomized algorithm. For the second list, the output for the number 
of bins should be at most (/(n) + 2)(2 — e). By inequality ((3|), it is impossible to pack the first list 
items. This brings a contradiction. I 

Corollary 12. There is no o( ^n" ) time randomized approximation scheme algorithm for the 

bin packing problem. 

Proof: It follows from Theorem [TT] I 



5. Generalization of the Deterministic Algorithm 

In this section, we generalize the existing deterministic algorithm jllj to handle the bin packing 
problem with multiple sizes of bins. The bin packing problem is under a more general version that 
allows different size of bins with different weights (costs). The results of this section are used as 
submodules in both sublinear time algorithms and streaming algorithms. 

Definition 13. 

• For an item y and an integer h, define y^ to be h copies of item y. 

• A type Ti of a bin of size s is represented by {a^^'\ . . . ,a/''), which satisfies ^j^i bjiUi < s. 
A bin of type Ti can pack bi^i items of size ai, . . . ,, and bt.i items of size at- We use WTi to 
represent the weight of a bin of type Ti . 

It is easy to see that an optimal bin packing with (c, ?/, fc)-related bins only uses bins with 
Sii < Si^ < . . . < Sij. with Wi-^ < Wi^ < . . . < Wif^ . The classical bin packing problem only has one 
kind of bins of size 1. It is the bin packing problem with the (1, 1, l)-related bins. In the rest of 
this paper, a bin packing problem without indicating (c, 77, fc)-related bins means the classical bin 
packing problem. 

Lemma 14. Assume that c, rj, and k are constants. Assume that 6 is a constant. Given a bin 
packing problem with (c, 77, k)-related bins for B ~ {a""^, . . . , aj^™} with each ai > S, there is a nrfi^'S' 
time algorithm to give a solution (xi, . . . ,Xq) with at most Optc.ri,k{B) + X]i=i "^Ta where Xi is the 
number of bins of type Ti, and q is the number of types to pack items of sizes in {ai, . . . , am} with 
q < km's . 

Proof: Since a^ is at least 5, the number of items in each bin is at most -g. Therefore, the number 
of types of bins is at most km'^ . Let Ti, . . . ,Tq be the all of the possible types of bins to pack the 
items of size ai , . . . , a„i ■ 

Let Xi be the number of bins with type Ti. We define the linear programming conditions: 

9 
min > WTiXi subject to (5) 



4=1 



/ l}j,iXi > Uj for J = 1, 2, . . . , ?7i (6) 

i=l 

X, > 0. (7) 

After obtaining the optimal solution (xj, . . . , x*) of the linear programming, the algorithm out- 
puts (xi,...,Xg) = ([x|] , . . . , [x*]). Since [x*] < x* + 1, the cost for (xi,...,Xg) is at most 
Optc,,,,kiB) + J2U1 ^Ti ■ 
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Algorithm Pack-Large-Items(c, i], k, B) 

Input: parameters c, ?/, k and a list B = {a"^ . . . , a"^"} to be packed in (c, 77, fc) related bins. 

Output: an approximation for Optc.ri.kiB). 

Steps: 

Solve the linear programming ©-([T]) for x^, . . . , x* 

Let Xi = \x*~\ for i = 1, . . . , g. 

Output (Xl, . . . ,Xq). 

End of Algorithm 



I 



With a constant e to control the approximation ratio, we define the following constants for 
Lemma [20I We will also define a threshold 6 to control the size of large items. Let 

ei := — p^, and (9) 

m := 1^[.-1. (10) 

Lemma 15. Assume that c, rj, and k are positive constants, and e and 5 are constants in (0,1). 
Assume that the input list is S for bin packing problem with [c^rj^k) -related bins and the size of 
each item in S is at least 5. Let e be a constant in (0, 1). The constants J, /i, ei, and m are given 
according to equations ^ to ilO\} . Let h = I —J . Then there exists an 0{n) time algorithm that gives 
an approximation app with Optc_n.k{S) < app < (1 + e)Optc.r^.k{S) for all large n, where n ~ \S\. 

Proof: Assume that ai < 02 < ■ • ■ < On is the increasing order of all input elements at least 
6 with n' = |S'>i|. Let Lq ^ ai < 02 < ■ ■ ■ < ««. We partition ai < 02 < . . . < a„ into 
AiyiA2y2 ■ ■ ■ AmUmR such that each Ai has exactly h—1 elements and R has less than h elements. 

Using algorithm the classical algorithm, we can find the i/i-th element yi each in 0{n) time. 

Consider the bin packing problems: Li = y^y!^ . . .y'^^. We show that there is a small difference 
between the results of two bin packing problems for Lq and ii. 

1) Assume that Lq has a bin packing solution. It can be converted into a solution for Li via an 
adaption to that of Lq (see Definition I13p with a small number of additional bins. 

Use the lots for the elements between yi and y^+i in Lq to store the elements of y^s, there are at 
most 2h y.iS left. Therefore, we only have at most 2h elements left. The number of bins for packing 
those left items is at most 2ft,, which cost at most 2h since 1 is the maximal cost of one bin. 

2) Assume that Li has a bin packing solution. It can be converted into a solution for Lq with a 
small number of additional bins. 

We use the lots for yi to store the elements between yi-i and yi. We have at most 2h elements 
left, which cost at most 2h since 1 is the maximal cost of one bin. 

The optimal number bins Optc.ri.k{Lo) for packing Lq is at least mhS, which have cost at least 
mhSrj. Therefore, we have 

Opic,77,fc(io) > mhSr] (11) 

Let App(Lq) be an approximation for Lq and App{Li) be an approximation for Li. We can obtain 
an (1 + e/2)-approximation App{Li) for packing Li by Lemma HM We have that 

App{Lo) = App{Li) + 2h 

< (l + e/2)Opt,,„,fe(ii) + 2/i 

< ((1 + e/2){Opt,,,,k{LQ) + 2h) + 2h 
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< iil + e/2)Optc,^,kiLo) + 6h 

< (1 + e/2)Optc.,^.k{Lo) + Opt^.^.k{Lo){——) (by inequality (HH)) 

mhorj 

6 

= (1 + e/2)0ptc,„,fc(io) + Opt^^rjALo)- 



mSri 

< (1 + e/2)0pt,^„ALa) + Opt,^^,kiLo){e/2) (by equations ® to ^.) 

< (l + e)Opt„,,fe(Lo). 

By the analysis at case 2), if App{Li) > Optc^n,k{Li), we also have that the cost App{Li) + 2h 
is enough to pack all items in Lo- Therefore, 

App{L^) > Opic,„,fc(io). (12) 

For a bin bi, let l{bi) be the sum of sizes of items packed in it. 

Algorithm Packing(Lo) 

Input: a list Lq := {oi . . . a,„} 

Output; an approximation for Optc^n^kiLa). 

Steps: 

Find the ih-th element yi in Lq for i = 1, . . . ,m. 

hetL,:=y1y!^...yt 

Let (xi, . . . ,Xq) :=Pack-Large-Items(l, 1, l,ii) (see Lemma [H)) . 

Let App{Li) := X^Li ^TiXi. 

Convert App{Li) to App{Lq) according to equation ([121 . 

Let B = bi, . . . ,bu be the list of bins used for packing (each bi has /(&i) available). 

Output App{Lq), and list i? of bins. 
End of Algorithm 

We note that the list of bins bi, . . . ,bu with their used space l{bi) for each bin can be computed 
in 0{n) time from the conversion based on [xi^ . . . ,Xq) for q types Ti, . . . , Tg. 

I 

Lemma 16 ( [11] ). Let 13 be a constant in (0,1). Then there exists an 0{n) time algorithm that 
gives an approximation app for packing S with Opt{S) < app < (1 + P)Opt{S) + 1 for all large n. 

Proof: The bin packing problem is the same as the regular bin packing problem that all bins are 
of the same size 1. The problem is to minimize the total number bins to pack all items. We consider 
the approximation to pack the small items after packing large items. 

Assume that the input list is S for bin packing problem. Let S'<5 be the items of size less than 
S, and S>s be the items of size at least S. Let 6 he a, constant with S < j. 

Algorithm Linear-Time-Packing(?i, S) 

Input: A list of items 5 = oi . . . a„ and its number of items n. 

Output: an approximation for Opt{S). 

Steps: 

1. Let App{S>s) and the bin list 6i,...,6„ be the output from calling Packing(5>5) (see 
Lemma llSp . 

2. for i = 1 to It 

3. lil{b^)<l-S 

4. Fill items from S'<5 into 6,; until less than S space left in bi or all items in S<:s are packed. 

5. If there are some items of size less than 6 left 
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6. Then pack them into some bins so that at most one bin having more than 6 space used. 

7. Output the total number of bins used. 
End of Algorithm 

Assume that an optimal solution of a bin packing problem has two types of bins. Each of the 
first type contains at least one item of size at least 5, and each of the second type only contain 
items of size less than S. Let Vi be the set of first type bins, and V2 be the set of all second type 
bins. Let U = App{S>s) be an (1 + /3)-approximation for packing the first type of items. We have 

|C/|<(l + /3)|^i|. 

Fill all items into those bins in U so that each bin has less than S left. Put all of the items less 
than S into some extra bins, and at most one of them has more than S space left. 

Case 1. If U can contain all items, we have that \U\ < (1 + P)\Vi\ < (1 + /3)|Vi U ¥2] = 
il+^)Opt{S). 

Case 2. There is a bin beyond those in U is used. Let U' be all bins without more than S space 
left. We have that \U'\ < ^^|^ < (1 + /3)|Vi U V'zl = (1 + P)Opt{S). Therefore, the approximate 
solution is at most (1 + /3)|li U V2I + 1 = (1 + /3)Opt{S) + 1. 

I 



6. Randomized Offline Algorithm 

In this section, we present sublinear time approximation schemes in the offline model. 

6.1. Selecting Items from A List 

In this section, we show how a randomized algorithm to select some crucial items from a list. Those 
elements are used for converting the packing large items into linear programming as described in 
Section El 

In order to let linear programming have a small number of cases, the ih-th. elements are selected 
for i = l,2,...,m, where the large items are grouped into m groups with h items each. The 
approximate ih-th elements (for i = 1, . . . , m) have similar performance as the exact ih-th. elements in 
the linear programming method. The approximate ih-th elements (for i — 1, . . . , m) can be obtained 
via sampling small number of items. The ih-th element among the large items is approximated by 
the ih-th element among the random samples from large items in the input list. The detail of the 
algorithm is given at Select-Crucial-Items(.). 

For a finite set A, let \A\ be the number of elements in A. For a list L of items ai, . . . ,a„, let 
\L\^n. 

Definition 17. Assume that L = ai, . . . , a„ is the list of real numbers, and x is an integer. 

• Define Rank(a;, L) in ai, . . . ,a„ to be the interval [a,b] such that \{i : ai < x}\ = a — 1 and 
\{i : Ui < x}\ = b. Define minRank(a;, L) to be a and maxRank(x, L) to be b. 

• Define Rank5(a:;, L) in ai, . . . , a„ to be the interval [a, 6] such that \{i : ai < x and ai > 6}\ = 
a — 1 and \{i : ai < x and ai > S}\ = b. Define minRank5(a;, L) to be a and maxRank5(a:;, L) 
to be 6. 

• L[s, t] = Os, Cs+i, . ■ . ,at for < s < t < n. 

Definition 18. Assume that S* is a list of items for a bin packing problem and (5 is a real number. 
Define S'<5 to be the sublist of the items of size less than 5 in 5, and S>s to be the sublist of the 
items of size at least S in S. 
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By the definitions [T7] and [TSl we have 

imiiRanks{x, L) ~ minRank(a;, L>5), 

maxRaiiks{x, L) = niaxRank(x,i>i-), 

Kanksix, L) = Ilank{x, L>s). 

Let m be a parameter at most n and let 



and 



(13) 
(14) 
(15) 



(16) 



Let the sorted input hst is partitioned into K1K2 ■ 
h, and < |i?| < h. 



. K^R such that \Ki\ = \K2 



\K„ 



Algorithm Select-Crucial- Items(TO, a, //, X) 

Input: two constants a and // in (0,1), an integer parameter m at least 2, and a list X 
cci, X2, . . . , is a finite list of random elements in A. 
Steps: 



1. 
2. 

3. 

4. 
5. 

6. 



Am ' 



Select 7 

Select constant cq and u 



c-o log m 



such that 2me 



< a and 3 < ju. 

If u < u or \X\ < u, then output and stop the algorithm. 
Let n, := — for i = 1, . . . , ttj. 

1, . . . , to) be the least element Xj such that |{i : Xt is in X[l, w] and Xt <Xj}\ > 



Let y, {i 
\piu]. 

Output (yi,...,y„). 

End of Algorithm 

Lemma 1191 shows the performance of the algorithm Algorithm Sclect-Crucial-Itcms(.). It is a 
step to convert the step for packing large items into a dynamic programming method. When the 
input list of items is S, the list A in Lemma [12] is the sublist S>s of all items of S with size at least 
S, which will be specified in the full algorithm. The random items X is generated from the subset 
of all random items of sizes at least J in a set of random items in S. 

Lemma 19. Let /i and a be positive constants in (0, 1). Assume that A is an input list of n numbers 
of size at least 5 with n > ^™ . Then the algorithm Select-Crucial-Items{.) runs in 0( '" "s™^ 1 ^ 

time such that given a list X of at least '^1™ ^Qg™ random, elements from A, it generates elements 
2/1 < ... < y„i from the input list such that Pr[Rank(j/i, A) n [ih — fih, ih + fih]] = for at least one 
i G {1, . . . ,m}] < a, where C\ — 16co, and Cq is the constant defined in Select- Crucial- Items (.), and 
m is an integer at most n. 

Proof: The algorithm probabilistic performance is analyzed with Chernoff bounds. Note that the 
number of items n in A is not an input of this algorithm. We only use it in the analysis, but not in 
the algorithm. Without loss of generality, we assume \X\ — u, where u is defined in statement [2] in 
the Algorithm Select-Crucial-Itcms(.). 



According to the algorithm u 



logm 



IGcpTn log m 



ci 7n log m 



We assume the 



number of random items in X is at least u. By the equation p6l) and the fact tti < n, we have 

n 
h < — < h + 1 <2h, and (17) 

TO 

i < 1. (18) 

n TO 
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"^ 




n 


^ 


ih 


^h 




n 


n 


< 


i 


fih 




m 


n 


< 


Pi- 


n 



By statement [T] in Select-Crucial-Items(.) and inequality P7)) . we have — < 2h and 

27<f<^. (19) 

2m n 

Assume maxRank(yi, A) < ih — fih. Wc have that 

maxRank(yi , A) ^ ih — ^h . , 

(21) 
(by inequahty ^) (22) 

(23) 

Let p^ :— Pi — — > (y,, ) j-|^y inequahty (1^51) ). By CoroharylBl with probabihty at most 

e 3 , we have |{j : Xj £ X[l, u] and Xj < yi}\ to be at least 

maxRank(yj,A) ^ / , 

/i/i 
= (k-( — ))m + 7M 
n 

= PiU-( 7)u 

< PiU ~ "fu (by incgualitv (|19p ) 

< \piu] 

Assume minRank(y.j, A) > ih + fih. Wc have that 

minRank(j/i, A) ih + fih . 

n n 

= !^ + ^ (25) 

n n 

> h ^— (by equation dUl)) (26) 

m n n 

i nh , ^ 

> K-- + — . 27 

n n 

Note that the transition from inequality (|25p to inequality (P5|) is due to equation (HH])), which 
implies /i > — — 1 and ^ > J- — 1. 

Let p'f ■= p, - ^ + H^ < """Ra'^k(j;..A) ^^y inequality ([27]). Note that p, is defined at hue H in 

2 

Algorithm Sclcct-Crucial-Items(.). By Lemma |6l with probability at most Pi^i = e 3~^ we have 
\{j : Xj G X[l, u] and Xj < yi}\ to be at most 

maxRank(7/,,A) „ 

( j)u > p^u — ju (28) 

i uh^ , ^ 

- P,-- + — u-7" 29) 

n n 

> p,u+{^----f)u (30) 

n n 

> PiU+{ 7)u (31) 

n n 
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,uh m. ,2nh , . „. 

> P.u+i^ )u + {-^-j)u 32 

on n 6n 

> p,M + 0+(^-7)w (33) 

3n 

> P^U+{^-J)u (34) 

> PiU + -u (35) 

> PiU+l (36) 

> \p^u^ . (37) 



Note that i < m. The transition from inequahty (|32|) to inequahty ((33|) is due to the condition 
n > ^iin±nl which imphes that /i > ^ - 1 > ^illl±}l - i > ^ + 1 - i > 3rn_ r^j^^ transition from 
inequahty (p3|) to inequahty (p4)) is because of inequahty p^ . The transition from inequahty (|35|) 
to inequahty ([5S)) is due to the setting in statement [5] in Select-Crucial-Items(.). 

2 

Therefore, with probabihty at most ^^i{Pi,i + Pi.2) < 2me~^ < a, Rank(yi, A) n [ih — 
fj.h, ih + ^h] = for at least one i € {1, . . . , m}. 

I 

6.2. Packing Large Items and Small Items 

In this section, we show how to pack large items from sampling items in the input list. Then we 
show how to pack small items after packing large items. 

Lemma 20. Assume that c, rj, and k are positive constants, and e and 6 are constants in (0, 1) and 
6 is a constant in [0, 1). Assume that the input list is S for a bin packing problem with (c, 77, k)-related 
bins. The constants (5, /i, ei, and m are given according to equations (0) to ilO\) . Assume that n'^g 
is an approximation of \S>s\ satisfying 

{I - 0)\S>s\ < n'^s < {1 + e)\S>s\, (38) 

^ < e, and (39) 

drj 



\S>s 



> 1 ife>0. (40) 



Let h 



\S>6\ 



\,h'= — ^ , and S' be a list of items of size less than S. Assume that we have the 
following inputs available: 

• Let y[, . . . , y^j be a list of items from S>s such that Rank(2;,', S>s) H [ih — ^h, ih + i^ih] ^ for 
i = 1,2, ... ,m 

• An approximate solution for bin packing with items in B — {y'l' ,. .. ,y'J^ } U S" in {c,ri,k)- 
related bins with cost at most (1 + e)Optc.ri.k{B) 

Then there Packing- Conversion(.) is an 0{1) time algorithm that gives an approximation app with 
Optc,^^k{S>5 U S') < app < (1 + 5e)Optc,-nAS>s U S'). 

Proof: Assume that a[ < 02 < . . . < a'^ is the increasing order of all input elements of size at 
least S with n>s = \S>s\- Let 



Let 



L. = a'l < 4 < . . . < a^^^ U S'. (41) 

Lo^a[<a'2< ...<a'^, U 5". (42) 
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Note that in the ease n'^f- > \S>s\, we let a'. 



''\S>s\+l 



1 in hst Lq. Partition a[ < a!^ < 



„ into AiyiA2y2 ■ ■ ■ AmiJm.R such that each Ai has exactly h — 1 elements and R has less 



...<a[ 

than h elements. Partition a\ < ai, < . . . < a', into AiyiA2y2 ... A 

exactly /i — 1 elements and R' has less than h elements. We have 



> 



> 



> 



> 



h 

"(1- 


0)n>s 




h 



{l-0)n>s 



h 
(1-9) 



- 1 



n>5 



(1-20) 
{l-2e)m 



h 



(by inequality pO])) 



>R' such that each Ai has 

(43) 

(44) 

(45) 

(46) 

(47) 
(48) 



We have 



We have 



h' 



< 



< 



"'>6 
h 

{l + 9)n>s 
h 
il + 0)n>s 



h 



< (1 + 9) 

< (1 + 26 



h 



(1 + 261)™. 



'->5 



< 



(by inequality PO]) ') 



{l + 0)n>s 



< [{l + 0){h + l)\ 

< [{l + e){h + eh)\ (by inequality ^) 

< [i^ + Ofh\ 

< {i + efh 

< (l + 36')/i. 



h' > 



> 



(1 - 0)n>s 



> 



(1 - 26')n>5 + en>5 



(1„ 20)^ + ^1^ 
m m 



> 
> 



(1 - 26) 
a - 29) 



> (1 - 29) 

> {l-29)h. 



. m 

n>s 

m . 
n>s 



9n 



>5 



(49) 

(50) 

(51) 

(52) 

(53) 
(54) 

(55) 

(56) 
(57) 
(58) 
(59) 
(60) 

(61) 

(62) 

(63) 
(64) 

(65) 
(66) 
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The transition from inequality (pT|) to inequality (|55| is due to the fact ^^ > 1 by inequali- 
ties dSS]) and (gni). By inequalities dM]) to dSH), we have 

(1 + W)h >h' >{l- 29)h. (67) 

Inequality (|57)) also holds if = 0. 

Consider the bin packing problems: Li = y'^ y'^ ■ ■ -Vm US". Wc show that there is a small 
difference between the results of two bin packing problems for Lq and Li. 

Claim [20l l. For every solution of cost x with (c, ry, fc)-related bins for list Lq, there is a solution 
of cost at most x + (100 + A^)mh + 4/i for list Li. 

Proof: Assume that Lq has a bin packing solution. It can be converted into a solution for Li via 
an adaption to that of Lq with a small number of additional bins. 

We use the lots for the elements in Ai+iy^+i in Lq to store the elements of y[s. By inequality (|67)) 
and the assumption Rank5(2/^, 5'>5) n [ih — ^h, ih + ^h] 7^ for i = 1, 2, . . . , m, there are at most 
(30 + 2^)h j/,'s left as unpacked for each y'/^ with i < m! . Therefore, we only have that the number 
of elements left as unpacked in Li is at most 

m'(36l + 2yL)h + {\m - m'\ + 2)h' 
< {3e + 2fi){l + 29)mh + {2Om + 2){l + 30)h (bv inequalitv (|67l) and (|48l)). 

The number of bins for packing those left items is at most {39 + 2^){l + 2d)mh + {29m + 2){l +39)h. 
Since 1 is the maximal cost of one bin, the cost for packing the left items at most 

(36* + 2^)(1 + 29)mh + {29m + 2)(1 + 39)h 

< 2(36* + 2^i)mh + 2(29m + 2)h (by inequality ([39l) ) 

< (106* + V)TOft. + 4/i. 

I 

Claim [20I 2. For every solution of cost y with (c, 77, fc)-rclatcd bins for list Li, there is a solution 
of cost at most y + (/i + 29)mh + 2h for list Lq- 

Proof: Assume that Li has a bin packing solution. It can be converted into a solution for Lq 
with a small number of additional bins. 

We use the lots for y[^ to store the elements in Aiyi. We have at most (/i + 29)h elements left 
for each Aiyi. Totally, we have at most m(/x + 26)h + 2/i items left. The bins for packing those left 
items is at most m(/z + 26)h + 2h, which cost at most m(/x + 29)h + 2h since 1 is the maximal cost 
of one bin. I 

The optimal number bins Optc,ri,kiLo) for packing Lq is at least mhS, which have cost at least 
mhSrj. Therefore, we have 

Optc^r,,k{La) > mhSi] (68) 

For an approximation App{Li) for packing Li, let 

App{Lq) = App{Li) + {fi + 29)mh + 2h (69) 

be an approximation for packing Lq by Claim [20l 2. We have that 

Opt,^n,k{La) (70) 

< App{U) (71) 
= App{Li) + m{n + 29)h + 2h (by equation dMl)) (72) 

< {\ + e)Optc.,^.k{Li)+m(ji + 29)h + 2h (73) 
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< ((1 + e){Optc,r,M{Lo) + (106* + A^m)mh + Ah) + m{fi + 2e)h + 2/i 
(by Claim [201 1) 

, bfxmh + 129mh + 6h 



< (1 + e){Optc,rjALo) + Optc,rjALo)(.- 



mhSri 



(74) 
(75) 

)) (by inequality §8^) (76) 



= (1 + e)Optc.ri.k{Lo) + Op<c,r,,fc(io)(T^ + T- + -^) 

orj orj morj 

< (1 + e)Optc^r,ALQ) + Optc,riALa){-f- + — + |) (by equation dlOl) 

< (1 + e)(Optc,„,fe(io) + Opic,„,fc(io)(^ + I + i^^ ^^^ inequality ([39 

< (1 + e)(Op<,,^,fc(Lo) + Optc,rj,k{Lo){^ + i + i^^ ^^^ equation dH])) 

< (l + e)(l + e)Opf,,^,fc(io) 

< (l + 3e)Opie,^,fc(Lo)- 

The list i* has at most dnys niore items than Xq- Therefore 
Optc,n,k{L*) = Optcj,M{Lo) + 07i>s 

.k{Lo) ■ ^ ' 



< OpU 

< Optc^j^ 

< Optc^j^ 

< Optc,^ 

< Optc^ri 

< OpU 

< OpU,r, 

< Optcr 



1-9 



i-ys 



,fe(io)(l 



,fe(io)(l 



= (io)(l 



Oni 



>s 



(l-0)Opt„^fc(io)' 



en'^ 



>5 



(1 - e)mh5T] 



) (by inequality (|68l 



'■>5 



(1 - e)hSr] m ' 

g 

fe(io)(l + ,^ _ g.^^ • 2/i) (by inequality (HB) 

.(io)(l + ^) 

fc(Lo)(l + e) (by inequality (|MD)- 



Let 



App{L^,) = {l + e)App{L^). 



(77) 
(78) 
(79) 

(80) 

(81) 
(82) 

(83) 
(84) 

(85) 
(86) 
(87) 



(89) 

(90) 
(91) 

(92) 



Therefore, we have App{L^) > Optcn.ki^*) by inequality ((T^ and inequality (pij) . On the other 
hand, we have App(L*) = (l + e)App(Lo) < (l + e)(l + 3e)Optc.r,.fe(-^o) < (l + e)(l + 3e)Opic,^,fc(i*) < 
(l + 5e)Opt,,^,fc(L0. I 

Algorithm Packing-Conversion(n'->^, App(ii)) 

Input: an integer n>^- is an approximation to \S>s\ with (1 — 6')|S'>i-| < n'yg < (1 + 6')|S'>5|, 

and an approximate solution App{Li) for the bin packing with items in Li = {yf' , • ■ • , y'm } U 5' in 
(c, 7], fc)-related bins with cost at most (1 + e)Optc,rj,k{Li), where Li = {y'l , . . . , y^ } U S" is a list 
of items such that Rank(j/^, S>s) H [ih — jih, ih + jih] 7^ for i = 1, 2, . . . , to, and S' is a list of items 
of size less than 5. 

Output: an approximation for Optc^^A^*)^ where L* is defined by equation (|4ip. 

Steps: 
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Convert the approximation of App{Li) to App{Lq) as equation (j69p in the proof. 
Convert the approximation of App(Lq) to App{L^) as equation (j92p . 
Output App(L,:) 
End of Algorithm 

Lemma 21. Let ^ be a small constant in (0, 1). Assume that S>^ is a list of items of size at least 
ip, S'<^ is a list of items of size less than Lp, and S*^ is another list of items of size less than (p. 
V T.a,es^^ a* + Ea.es>^ «« < (1 + OiEa.eS'^^ a, + Ea^^s>^ a,) and Ea,es'^^ a, + Ea.es>^ «» < 
(l+0(Ea,es<,«« + Ea.e5>,a'), i/^eri Op<(5<^U5>^) < i±i .Opi(5^^u5>^) + 1 and Opt{S'^^U 
S>^)<^.Opt{S<^US> 



VI ^ ^■ 

Proof: Let L = 5'<^U5'>y and L' = 5<^U5>y. Witliout loss of generality, let Opt{L) < Opt{L'). 
We just need to prove that Opt{L') < j^ ■ Opt{L). 

For a bin packing P for L, we convert it into another bin packing for L' by increasing small 
number of bins. At most one bin in P wastes more than ip space by replacing the items in 5'<^ with 
those in S'<^. If no additional bin is used for packing L', we have Opt{L') < Opt{L). 

If some new bins are needed, the total number of bins is at most 



1 — (^ \ — P 

< ^^ • Opt{L) + 1. 

1-ip 

Therefore, we have Opt{L') < ^ ■ Opt{L). I 

The following Lemma [22] is only for the classical bin packing problem that all bins are of the 
same size 1. 

Algorithm Packing-Small- Items(X, si, S") 

Input: X = {xi, . . . ,Xq) for the q types T = (Ti, . . . ,Tq) for the (1 + /3)-approximation for 

packing a list S" = {y'l^ , ■ ■ ■ , y'm }; ^^.d si := 'Yla-eS' '^* ^^ ^^^ sum of sizes in list 5" of items of size 
less than 5. 

Output: an approximation for Opt{S" U S"). 

Steps: 

1. Let s'l :~ si. 

2. Repeat 

3. Let i := 1. 

4. For each type Ti = (foi.ifli, . . . , bm.iO-m) (which satisfies Ei^i bj,iai < 1) 

5. Let ti :— ETli bj.iO-m and hi := max(l — 5 — ti, 0) 

6. {hi is the available space in a bin of type Ti for packing items of size < 5). 

7. Let s'l :^ max(s']^ — Xihi, 0) (fill each bin of type Ti with size hi of (fractional) items). 

8. Let i:=i + 1. 

9. Until s'l = or i > q. 

10. If s'l > 

11. Then find the least number k such that k{l — 5) > s'^ 
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12. and fill the (fractional) items left in s[ into those k bins. 

End of Algorithm 

Lemma 22. Let /3 be a constant in (0, 1) with (i < ■^, 9 he a constant in [0, 1) with 9 < (3, and 5 
he a constant with (5 < 4 • Let m and h' he integers. Let S' he a list of items of size less than 5. 
Assume that S" ~ {y'l , . . . , y^ } with y[ > 6 for i ~ 1, . . . ,m and S" is large enough to satisfy 

h'm>^. (93) 

Then Packing- Small- Ltems(.) is an 0{q) time algorithm that given a solution {xi, . . . ,Xq) for hin 
packing with items in S" with the total numher of hins at most (1 + /3)0pt{S"), and si — '^g^.^g, Oi, 
where Xi is the numher of hins of type Ti, and q is the numher of types to pack y'l, ■ ■ ■ ,2/^ with 
q < irP^'s' (see LemmaU^, it gives an approximation app for packing S" U S' with Opt{S" U S") < 
app< {l + 2(i)0pt{S"\JS'). 

Proof: The bin packing problem is the same as the regular bin packing problem that all bins are 
of the same size 1. The problem is to minimize the total number bins to pack all items. We consider 
the approximation to pack the small items after packing large items. 

Assume that an optimal solution of a bin packing problem has two types of bins. Each first type 
bin contains at least one item of size (5, and each second type bin only contains items of size less than 
5. Let Vi be the set of first type bins, and V2 be the set of aU second type bins. Let U be an (1 + /?)- 
approximation for the items in S" . Wc have \U\ < (1 + /3)|T4|- Let siarge = "^ai^s" ^i ~ '^1=1 ^'iV'i 

and Ssmall = SaiGS' "* = '^l' 

Fill items of size less than 6 into those bins in U so that each bin has less than 5 left. Put all of 
the items less than 5 into some extra bins, and at most one of them has more than 5 space left. We 
use a fractional way to pack small items. Since each bin with small items has at least 5 space left, 
and each small item is of size at most (5, the fractional packing of small items can be converted into 
a non- fractional packing. A similar argument is also shown in Lemma [5T] 

Case 1. If U can contain all items, we have that \U\ < (1 + P)\Vi\ < (1 + li)\Vi U ^2!- 
Case 2. There is a bin beyond those in U is used. Let U' be all bins without more than 5 space 
left. We have 

\Tjl\ ^ Siarge + Ssmall /„.-, 

c 

< (1 + y— T)(s;arffe +SsmaZ;) (95) 

< {l + 2S){siarge + Ssmall) (96) 

< {l+P/2){siarge+ Ssmall)- (97) 

On the other hand, |Vi U V2I > siarge + Ssmaii- Therefore, the approximate solution |C/'| + 1 has 

\U'\ + 1 < (1 + ,3/2)1^1 U V^al + 1 (by inequality ^) (98) 

= (1 + f3/2)Opt{S" U S") + 1 (99) 

< (1 + l.5P)Opt{S" U S') (by inequality 1^) (100) 

< {l + 2f3)Opt{S"US'). (101) 

Packing the items in S" needs at least 5mh' bins. Therefore, the transition from inequality (|99l) to 
inequality (|100|) is by the condition in inequality ([M|. I 

Algorithm Packing-With-Many-Large-Items(a, /3, n, si , n'^g, S) 
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Input: a parameter j3 e (0, 1), n'^^ is an approximation to |S'>5|, and si is an approximation for 

T.a,(^s^s "* ^^*^^ (1 ~ ?)(Ea.es«i)~^ *i + T.a,^s>, ^^ < (1 + C)(Ea.eS»0' ^ i^ the list of input 
items ai, . . . , a,i for bin packing, and n is the number of items in 5*. 

Output: an approximation for Opt{S). 

Steps: 

1. Select an integer constant di such that .91(2)^"^ < o;- 

2. Select a list Li of 2cidi— P— m^ logr/i random elements in the input list S, 
where constant ci is defined in Lemma 1191 and constant di is defined in line |H1 

3. Let L2 be the list of items of size at least J in Li. 

4. Let {y'l, . . . , y^):=Select-Crucial-Items(r?T,, a, /^, L2) (see Lemma [TO]) . 

5. Let X ~ [xi, . . . ,Xq) :=Pack-Large-Items(l, 1, l,B) with B = {y'l^ ,. .. ,y[^ } 
(see Lemma [Ti|) . where h' = -^^ . 

6. Let ^ppi:=:Packing-Small-Items(X, si, i?) (see Lemma [22|) . 

7. Let App2 :=Packing-Conversion(n>^, Appi)(see Lemma [20| for packing all items in S. 

8. Output j^ ■ App2. 
End of Algorithm 

Lemma 23. Assume that S is a list of items for bin packing problem. Let (3 be a constant in (0, 1) 
with /3 < ■^, 6 be a constant in [0, 1) with 9 < (3, S be a constant with S < j, ^ be a constant with 
£, < J, and constant e = 6/3. The constants fi, e\, and m are given according to equations ^ to ilO\) . 
Assume that n'^g is an approximation of \S>s\ satisfying the inequalities IIS8\) . I139\). [JW, o,nd fPji- 
Assume that si is an approximation for "Ylia <^s ^« with (1 — C)(So gs'**) — *i '^ Ea gS "^^ — 
(1 + C)(I]aies"i)- Then Packing- With- Many- Large- Items (.) is an Oi^^ ^ 0{j^)^^^^) time 

algorithm that gives an approximation app for packing S with Opt{S) < app < (1 + 16/3)Opt{S) with 
the failure probability at most a. 

Proof: The bin packing problem is the same as the regular bin packing problem that all bins are 
of the same size 1. The problem is to minimize the total number bins to pack all items. We consider 
the approximation to pack the small items after packing large items. 

We sample some random items of size at least (p from the input list S. When an item from the 
input list 5* is randomly selected, an item of size at least ip has an equal probability, which is defined 
by the p^ below: 

_ \{i ■■ ai> if and aj € {ai,. . . ,«„}}! _ n>^ 

Pip — — ■ v^'J^J 

n n 

By inequality ([55)) and equation (|102p . we have 

Tl 1 
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^^ , Py „/ ™ logm 2cidi 2, ^^ 

By Theorem H with probabihty at most gi(i) >^ < 31(5)^^+^" '°*5™ < a (see HneHin 

ApproxhTLate-Bin-Packing(.)), we cannot obtain at least 

/1 1\ ,2cidin 9, X *"■ / , 2 1 N /1r^^^ 

(l-oiPvi — ; "^ logm) > p,p—;—icidim logm) (104) 

> -ci di 771^ logm fbv inequality (fT03)) ) (105) 

1 + & 

> ci 777^ logm (106) 

random elements of size at least (p by sampling 2cidi— P— m^logm elements. 

By Lemma [191 with probability at most a, we cannot obtain the list 7/1 < . . . < 7/,n from the 

2/1 \2-, 

input list such that Rank(yi, S>^) n [ih — /^/i, i/i + fj,h] ^ for all i £ {1, . . . , m} in 0( ™ ^ "I™-* ■' ) 
time using ^i™ ^ogm j-g^j^^^Qj^ elements from the input. 

Therefore, we have probability at most a + a + a < j, the following (a) or (b) is false: 

(a). Statements [U [51 and [3] of Lemma IH] are true. 

(b). Rank(7;j, S>^p) D [ih — ^h,ih + fih] ^ for all i £ {1, . . . , m}. 

Assume that both statements (a) and (b) are true in the rest of the proof. This makes the 
analysis of algorithm become deterministic. 

Imagine that S'l is a list of items of size less than 5 and has si = '^a-es' ^'i-- ^^ Lemma[22l lineHl 
gives Appi to be an (1 + 2/3)-approximation for packing S" U S[. 

By Lemma [201 App2 is an (1 + 5 x 2/3)-approximation for packing S>s U S'^. 

By Lemma [211 j^ ■ App2 is an Yr| • (1 + 10/3)-approximation for packing Sys U S^s = S. We 
note that 

[i|-(i + io/?) < (i + |ij)- (1 + 10/3) 

F 2(^ + 5)) • (1 + 10/?) 
F /3) • (1 + 10/3) 
I- /3 + +10/^ + 10/32) 
I- /3 + +IQP + 5^) (note that P < \) 
16^. 

Thus, Yzf • ^PP2 is an (1 + 16/3)-approximation for packing S>s U S^s — S . 

The function is executed under the condition that 77'--, = i^(X]i=i '^j)- Statement [51 takes 
0(— ?— ) = 0{-rr^ — ) time. The computational time at statement [5l is (-3) ^ which follows 

from Lemma [TH The other statements only takes 0(1) time. I 

The following Lemma [24l is only for the classical bin packing problem that all bins are of the 
same size 1. 

Algorithm Packing- With- Few-Large- Items (^, x, si) 

Input: a small parameter ^ € [0, 1), an integer x with x < ^X]?:=i '^i ^^"^ •'^ — \'^>s\i ^-nd a real si 
with (1 — OC^aGS ^*) — ^1 + '^a£S ^i ^ (1 + ?)(X]a sS ^*)' (^1 ^^ ^^ approximate sum of sizes 
of small items of size at most 6) . 

Output: an approximation for Opt{S). 

Steps: 

1. Find the least number k such that k{l — S) > si 

(the k bins are for packing items of size less than S) . 

2. Output j^ ■ {k + X + 1) for packing S {x bins are for packing items of size > S) 
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End of Algorithm 

Lemma 24. Assume that S is a list of items for bin packing problem,. Let S be a constant in (0, 1). 
Assume that we have the following inputs available: 

• X is an approximation for \S>s\ with x < CX]i;=i '^i ^'^'^ ^ — l'S'>i5| for some small ^ G (0, 1). 

• Si is an approximation for I]a,GS<a'^* "^^^^ (^ ^ C){Haies^i) - ^^ +J2aies>s'^i < (1 + 

and the param,eters satisfy the following conditions 

^ (107) 

(108) 

(109) 

Then Packing-With-Few-Large-Items(.) is an 0(1) time algorithm that gives an approximation app 
for packing S with Opt{S) < app < (1 + 8{S + ^))Opt{S). 

Proof: The bin packing problem is the same as the regular bin packing problem that all bins are 
of the same size 1. The problem is to minimize the total number bins to pack all items. 

Imagine 5^^ is a list of elements of size less than 6 and J2aes' ^i = •si- Let S' = 5*^^ U S>s- Let 
So = X]"=i o^i to be the sum of sizes of input items. By line [1] in Packing- With-Few-Large-Items(.), 
we have 

k + x < -^ + l + x (110) 

1—0 

^ Ml±il + ^.„ + i (111) 

1 — 

Furthermore, assume that the inequalities (|107p to (|109p holds. We have 

= (1 + 2(5 + 30 

Therefore, we have 

k + x + 1 < (1 + 2(5 + 300^^(5") + 1 

< {I + 35 + 3(,)Opt{S) (by inequality dTMl)). 

By Lemma [211 we have the jrf (1 + 35 + S^-approximation for packing 5*. We note that 

[^(1 + 3(5 + 30 < (l + ^)(l + 3(5 + 30 

< (l + 2(e + (5))(l + 35 + 30 

< 1 + 2{£, + 5) + {35 + 30 + 2{£, + 5){35 + 30 

< l + 2(e + <5)+3((5 + C) + 3((5 + 

< l + 8{£, + 5). 
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6.3. Full Sublinear Time Approximation Scheme for Bin Packing 

Now we present a sublinear time approximation scheme for the bin packing problem. The brief idea 
of our sublinear time algorithm is given in Section [2. II After setting up some parameters, it divides 
the interval (0, 1] for item sizes into 0(log n) intervals (0,1] = /i U . . . U /fe, called a (</?, S, 7)-partition 
as described in section |31 Applying the algorithm described in section |31 we get an approximation 
about the distribution of the items in the intervals /i, . . . , /j.. If the total size X]r=i ^* ^^ ^^^ small, for 
example 0(1), the linear time algorithm described in section [S] is used to output an approximation 
for the bin packing problem. Otherwise, we give a sublinear time approximation for the bin packing 
problem. In order to pack large items, we derive the approximate crucial items, which arc the 
approximate ih-th elements among the large items of size at least ip for i = 1, . . . ,to, where h and 
TO are defined in equations (|16p . and ((|10|)). respectively. The algorithm described in section [5] is 
used to pack large items. The small items arc filled into bins which have space left after packing 
large items, and some additional fresh bins. With the approximate sum of sizes of small items, we 
can calculate the approximate number of fresh bins to be needed to pack them. If the total sum of 
the sizes of large items is too small to affect the total approximation ratio, we just directly pack the 
small items according to approximate sum of the sizes of those small objects. 

Algorithm Approximate-Bin- Packing(T, n, S) 

Input: a positive real number r, an integer n, and a list S of n items ai, . . . , a„ in (0, 1]. 

Output: an approximation app with Opt{S) < app < (1 + T)Opt{S) + 1. 

Steps: 

1. Let /3 := ^ and e := 6/3. 

2. Let (5 := I and 6 :== 4|. 

4 36 

3. Let /i, ei and to are selected by equations ^, (J9l), and pO|) . respectively. 

4. Let c := 77 := fc := 1 (classical bin packing). 

5. Let a := 1/12. 

6. Let ip := S. 

7. Let 7 := 6^. 

8. Select an integer constant di such that (71(5)^"^ < a. 

9. Derive a {f, 6, 7)-partition P = IiU . . .U Ik for (0, 1]. 

10. Let (s, si, ri> ):=:Approximate-Interval((/?, S, 7, 9, a, P, n, S) (see Lemma [9|). 

n. If . < max((|^), (A . il±pi!ll ( i| . 0^)) 

12. then 

13. Output Linear-Time-Packing(n, S) (see Lemma [T6|) and terminate the algorithm. 

14. If n'>^ > f s 

15. then 

16. Output Packing-With-Many-Large-Items(a,/3, n, si,n>^, 5) (see Lemma 

17. else 

18. If<^>0 
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19. then let x := ^ and ^ := niax((5^ 6* + 5^) 

20. else let x := 65s and ^ := niax(12(5, 6* + 5^). 

21. Output Packing- With- Few-Large- Items(^,x, si) (see Lemma [24)). 
End of Algorithm 

Proof: [Theorem [TU] Calling function Approximate-Interval (.) in line [TU] in the algorithm 
Approximate-Bin-Packing(.), we obtain s for an approximate sum X]i=i '^t ^f items in list S', si 
for an approximate sum of items in list S'<(^, an approximate number n> of items of size at least if 
(see Lemma ini). With probability at most a, at least one of statements [ll [51|31lll and [S] of Lemma [HI 
of Lemma [5] is false. Therefore, we have probability at most a, the following statement (a) is false: 

(a) . Statements [I] [21 El HI and \5\ of Lemma [HI are true. 

Assume that statement (a) is true in the rest of the proof. By statement [1] of Lemma [9l we have 
that if n'-> > 0, then 

{l~e)n>^<n'>^<{l + e)n>^. (113) 

Let So = X]"=i '^i- ^y line [TU] in Approximate-Bin-Packing(.) and Lemma [SI s is an approximation 
of So = X)"=i '^ii •*! i^ ^^ approximation of ^"^-^ ^.^^^cii, and n> is an approximation of the number 
n>tp of items of size at least ip. A {if, (5, 7)-partition for (0, 1] divides the interval (0, 1] into intervals 
/i == [7ri,7ro],/2 = (7r2,7ri],/3 = (tts, 7r2], . . . , 4- = (0,7rfc_i] as in Definition [71 

Claim [Tol l. If the condition in line[TTlof Approximate-Bin-Packing(.) is true, the algorithm 
outputs an approximation app{S) for the bin packing problem S with Opt{S) < app{S) < (1 -|- 

T)Opt{S) + 1. 

Proof: We note that if the condition in line [TI] is true, then s = 0(1) since (3,9,m, and S are 
all constants. By statement [3l of Lcmma[9l we have so = 0(1). In this case, we use the linear time 
deterministic algorithm by Lemma I16i which warrants the desired ratio of approximation. I 

In the rest of the proof, we assume that the condition in line [TI] is false. We have the inequality: 
^>-x((-),(-.^-^),(-.^)). (114) 

By inequality ()114p . we have the inequality 

Therefore, 

S<'-^. (116) 

By statement [21 of LemmalHl we have s < (1 + ^)(X]"=i "^0 = (1 + ^)so- By inequality (jllSp and 
the fact (5 < 1 (by the setting in line [2]), we have 

By inequality (|117p and statement [H of Lemma [HI we have 

1 " 

-{1-9){1- 6MY^ a,) < s < (1 + e)so. (118) 

Claim [T0l 2. If the condition at line [TU of the algorithm Approximatc-Bin-Packing(.) is true, 
then with failure probability at most a, the algorithm outputs an approximation app{S) for the bin 
packing problem with Opt{S) < app{S) < (1 + T)Opt{S) + 1. 
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Proof: Assume that the eondition at hnelTilof the algorithm Approximate-Bin-Packing(.) is true. 
This is the case that the number of large items is large. The condition of line [11] in Approximate- 
Bin-Packing(.) is false. Since condition of line [TJ] in Approximate-Bin-Packing(.) is true, we have 
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(by inequality pi4p ) 



> — :, (by inequality (|114p ) 



(119) 

(120) 
(121) 

(122) 
(123) 
(124) 
(125) 



where h' is defined is statement [5] of Packing- With-Many-Largc-Items(.). Note that the transition 
from inequality (|12ip to inequality (|122p is due to condition of line [HI in Approximate-Bin-Packing(.) 
is true, and the transition from inequality (|122p to inequality (|125p is due to inequality (|114p . Thus, 
the inequality (|93p condition in Lemma [20] is true. 

Inequality (|38p is satisfied because of inequality (|113p . Inequality ([5^ is satisfied because of the 
setting in lines[T]to[l]of Approximate-Bin-Packing(.). We have the inequality 
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(126) 
(127) 
(128) 

(129) 
(130) 
(131) 



The transition from inequality (|126p to inequality (|127l) is because the condition of statement [T3] 
of Approximate-Bin-Packing(.)) is true. The transition from inequality (|127p to inequality (|128p is 
because of inequality (|114p . Thus, inequality (|M]) is satisfied. 

By Lemma 1231 the algorithm gives an approximation app{S) such that Opt{S) < app{S) < 
{1 + 16 /3)Opt{S) < {l + T)Opt{S) (by the setting of /3 in statement[T]ofApproximate-Bin-Packing(.)) 
with the failure probability at most a. I 

Claim [T0l 3. If the condition at line [14] of the algorithm Approximate-Bin-Packing(.) is false, 
then the algorithm outputs an approximation app{S) for the bin packing problem with Opt{S) < 
app{S) < {1 + T)Opt{S) + 1. 
Proof: In the case that the condition at line [M] does not hold, we have that 
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(52 

< — (l + (5)so (by inequality dnH)) (133) 

S^ , ^ 

< yso. (134) 

Line [m in the algorithm Approxiniate-Bin-Packing(.) will be executed. By inequality (|117p . 
inequality (|109p is true. Inequalities p07p and (|108p follow from lines [T] and [2] in the Algorithm 
Approximate-Bin-Packing( . ) . 

By statements [T] and [2] of Lemma [9l we have 

si = ^ C(/,,5)^, (135) 

C'(/j,S)>0 and j>l 

> ^ (l-6')C(/j, S')7rj (by statement m of Lemma El) (136) 

C(/j,S)>0 and j>l 

> (1-0) ^ a^ (137) 

aje/j tu'itft C'(/j,S)>0 and j>l 

> (1-0) ^ a,- ^ ai (138) 

aiG/j and j>l ^^£7^ -ujit/i C(7j,S)=0 and j>\ 

> (1-6*) V aj-(— V aj + -). (by statements] of Lemma El) (139) 



ai^S<^^ aiGS^i^ 



We have 



< 



OiGlj with C{Ij,S)>0 and j>l 



(140) 



■-3 

si+ 5] a, > {l-9){ Y, «»)-(y E «* + ^)+ E °* (141) 

> (l-0)(^a,;)-(^ ^ a, + l) (142) 

(-3 

> (1 - 0)( ^ a,) - (- ^ a, + ^) (note S<^ C ^) (143) 

aiGS ai^S 

> (i-^-y)(E«')-^ (144) 

aiGS 

> (l-e- S^){ Y^ a,), (by inequality dmi)) (145) 

a.es 

By statements [1] and [2] of Lemma El we have 

SI = Y C{Ij,S)7r, (146) 

C'(7j,S)>0 and j>l 

< Y {1 + 9)C{Ij,S)tTj (by statement dl of Lemma El) (147) 

C{Ij,S)>0 and j>l 
1 + 9 



E «' (148) 



aieS<^, 



30 



By statement [T] of Lemma [HI we have 

si + V a» < V a, (150) 

^ — ' 1 — V — 

< (l + e')(l + 2^) ^ a, (151) 



< (l + 6i + 4(/9) ^ a,. (152) 

Therefore, 

{1 ~ {0 + S^'mY, a^) < si+ J2 a^<{l + {0 + A^)){Y,a^)■ (153) 

Since the condition at hne[T3]in Approximate-Bin-Packing(.) is false, we discuss two cases 
• Case n> > 0. 



We have the incquahties 



2_^ 0.1 < n>^ (154) 

< (l + 6l)n'>^ (by inequality (Uni)) (155) 

< 2n'>^ (156) 

< S^SQ. (by inequality (fT34| ) (157) 



By statement [T] of Lemma [9l we have 



also have 






->. 


< 


(52 


1-61 


4(1-0) 




< 


^2 



^>l^>^l- (158) 



s (linelMlin Approximatc-Bin-Packing(.) is false) (159) 

(160) 

< y(l + (5)so (by inequality dng)) (161) 

< S^SQ. (162) 

In this case, x = j^ by inequality (jl58p and inequalities (|159p to (|162p . and ^ = max((52,0 + 
5^) by inequality (|153p . They satisfy the conditions of Lemma [Ml which implies that the 
approximation ratio is (1 + 8((5 + ^)) < (1 + t) by the assignments in lines [1] and [5] in algorithm 
Approximate-Bin-Packing( . ) . 

Case n> ~ 0. 



By statement [2] of Lemma [9l we have 
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S^ 7 

< -—So H — (apply statement [2] of Lemma [9] with C(/i, S) = n'y ~ 0) 

2 71 -^ 

< yso + i^ 



(53 5 



s 



< Y^o + ~o~ (by inequality (|116p ) 

^3 (5'^fl + (5)s 

- y^"+ 8 (by inequality dmi)) 

3,53 

< —so 

3(53 8s ^ ^ 

< -^-r (bv mequahtv (fTT8| ) 

< 6(5^s. 



Therefore, 



|^>^| < 6(5s (163) 

< 6(5(1 + (5)so (164) 

< 12(5so. (165) 

In this case, let x = 6i5s by inequality (|163p , anii let S, — niax(12(5, + 5^ ,\ + + 4(/?) by 
inequality (|153p and inequalities (|163l) to (|165p . They satisfy the con(iitions of Lemma [531 which 
implies the approximation ratio is (1 + 8((5 + ^)) < (1 + r) by the assignments in lines [1] and [5] in 
algorithm Approximatc-Bin-Packing(.). This completes the proof of Claim[TUl3. I 

Claim [IS4. The algorithm runs in o( "(i°g")('°sJ°g") + (i)0(7)) time. 

Proof: We give the computational time about the algorithm. Lines [T] to [5] take 0(1) time. 

LineOtakes 0(log7i) time. By Lemma[31 Line [TUl takes 0{{'^^ — ) (log n) log log n)) time. Line 

Z^i=i ° ' 

1131 takes 0{n) time by calling Linear-Time-Packing(S') by Lemma 1161 This only happens when 

Er=i«.=o(i)- 

By Lemma [221 statement [TOl of Approximatc-Bin-Packing(.) takes 0{t-^ h 0{^y^T^') = 

Line [5T1 takes 0(1) time by Lemma [Ml Therefore, in the worst case, the algorithm takes 

Q^ »(logn)(log^log») ^ (i)O(i)) ^^^^ 

Claim [T0l 5. The failure probability of the algorithm is at most i. 
Proof: Two statements [TUl and [TBI in the algorithm may fail due to randomization. Each of them 
has probability at most a to fail by Lemma[ni(for statement (a)), and Claim[TUl2. Therefore, the 
failure probability of the entire algorithm is at most 2a < ^ . I 

I 

The theorem follows from the above claims. This completes the proof of Theorem [TOl 

I 

The following Theorem [25] gives a dense sublinear time hierarchy approximation scheme for bin 
packing problem. 

Theorem 25. For each e S (0, 1), and b € (0, 1], there is a randomize (1 + e)- approximation for 
all "^{n )-hin packing problems in time 0(n^~ (logn) loglogn) time, but there is no o(n} ) time 
(1 + e)- approximation algorithm 'Y^{n^)-bin packing problem. 
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five items of size 1 — I- . Let m 





Proof: It follows from Theorem [TU] and Theorem [TTJ I 

6.4. NP Hardness 

In this section, we show that X]("-'') ^^'^ ^{^) ^^'^ both NP-hard. We reduce the 3-partition problem, 
which is defined below, to them. 

Definition 26. The 3-partition problem is to decide whether a given multiset of integers in the 
range (^, -j) can be partitioned into triples that all have the same sum B, where B is an integer. 
More precisely, given a multiset S of n = 3t positive integers, can S be partitioned into m subsets 
S*!, 5*2, ..., S't such that the sum of the numbers in each subset is equal? 

It is well known that 3-partition problem is NP-complete |14j . It is used in proving the following 
NP-hard problems (Theorem [27] and Theorem [251) 

Theorem 27. For each constant b G (0, 1), the bin packing problem in '^{n'') is NP-hard. 

Proof: We construct a reduction from 3-partition problem to the X]("'')"bin packing problem 
via some padding. Assume that 6i, . . . , 6„ is a list of 3-partition problem with all items in ( — , -j)- 
The bin packing problem for '^{n^) is constructed below: 

It has a new list of elements: ai, . . . , a„, a„+i, . . . , a,„ such that X^iHi '^i ~ ^^ where a^ = -4- 
for i ~ 1, . . . , n, and each Oj with j > ri is 1, 1 — i or in (0, ^]. Furthermore, there are at most 

Therefore, we have m^ > n^ . This makes us the sufficient 

flexibility to select those items ai with i > n. Let s = X]i=i'*i- Select a number ni such that 
m^ — 5 < (ni — n) -\- s < m^ — 4. In other words, we have tti'' + 7i — s — 5<71i < m'' 4- n — s — 4. 
Thus, for all large n, we also have rti < m'' + ?i — s — 4 < m^ + n < 2m^ < ^ since 6 < 1. Let 
Oi — 1 for all i = n + 1, . . . , rii. Therefore, X)"=i '^i ^ I*^^ ~ 5' "*'' ~ 4). Then we select a^ with 
z = 1, . . . , 771, so that X]r=i '^i ^ ^- ^^ select the next five items a„'+i, . . . , an' +5 of size 1 — 4- Thus, 
S"=i "^i "= [m'' — l,m''). Let r = m''— ^"J^-i^ a^. We have re (0,1]. The rest items a„/_|-6i ctn'+Ti •••, ctm 
are partitioned into five groups Gi, G2, G3, G4, and G5 that size difference between any two of them 
is at most one. Each item in G^ is assigned ^."^ , € (0, i]. Thus, 1) J2a eG ^i ~ i' 2)X]i!ln'+6 '^i ~ '^' 

and 3) J2T=i"-i = ™^- 

There is an optimal bin packing solution such that the five items of size 1 — -I are in five bins 
with all items in the range (0, ■^]. There is a solution for the 3-partition problem if and only if the 
bin packing problem can be solved with j -\- (rii — n) -|- 5 bins. Any packing with j -\- (ni — n) -|- 5 
bins for ai, 02, . . • , «„ has to be the case that each item Oj with j > n' -f 5 is in a bin containing one 
item of size 1 — f since it is impossible for a^ {i < n) to share a bin with Oj [n' + 1 < 7 < n' -f 5). 

I 

Combining Theorem [27| and Theorem I25[ we see a sublinear time hierarchy of approximation 
scheme for a class of NP-hard problems, which are derived from bin packing problem. We show that 
the S'((5)-bin packing problem is NP-hard if 5 is at least j. 

Theorem 28. For each 5 at most j, the S{S)-bin packing problem is NP-hard. 

Proof: Wc reduce the 3-partition problem to S'((5)-bin packing problem. Assume that 5* = 
{fli, . . . , a^m} is an input of 3-partition. We design that a S'((5)-bin packing problem as below: the 
bin size is 1 and the items are ^ , . . . , ^^ . The size of each item is at least -j since each a^ > -j . It 
is easy to see that there is a solution for the 3-partition problem if and only if those items for the 
bin packing problem can be packed into in bins. I 
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7. Constant Time Approximation Scheme 

In this section, we show that there is a constant time approximation for the S'((5)-bin packing problem 
with (c, 77, fc)-related bins for any positive constant 6. 

Lemma 29. Assume that c, rj, and k are constants. Assume there is a t{m, n, ^) time and z{m, n, fi) 
queries algorithm A such that given a list S of items of size at least S, it returns m items y'i,y2, ■ ■ ■ , y'm 
from the list with Rank(y^, 5*) n [ih — /ift,, ih + fj.h] ^ for i = 1,2, ... ,m. Then there is an z{m, n, jjl) 
queries and t{m,n,fj,) + (jx)'^^'^' time approximation scheme B for the S{6)-bin packing problem 
with {c,ri,k) -related bins. Furthermore, if A fails with probability at most a, then B also fails with 
probability a. 

Proof: Assume that c, rj, and k arc positive constants. Let e be an arbitrary positive constant. 
The constants /x,ei, and m are given according to equations ([8]) to (|10|) . We let the number of 
elements n be large enough such that j^ < | , where q is defined at Lemma [T4l 

Assume that a[ < a'2 < . . . < 0,'^^ is the increasing order of all input elements at least 5. Let 
La ~ a'l < a'2 < . . ■ < a'^. We partition them into yo^iJ/1^22/2 • ■ • AmymR such that each Ai has 
exactly h elements and R has less than h elements. 

Using algorithm A, we make approximation y^ to yi such that the rank of y- has at most fih 
distance with that of yi. Assume that Rank(i/j', S) D [ih — iih, ih + jih] ^ for i = 1,2, . . . ,m from 
algorithm A. 

By Lemma I14[ we have approximation scheme for {y'l^ , . . . , y'J^l} with computational time 
(^)'^(^\ which follows from Lemma \JM and the selection of m and fx. The approximation scheme 
for 5((5)-bin packing problem follows from Lemma [201 The total time is t{m,n,fj,) + (^)'^*-^-' for 
running A and time involved in the algorithm of Lemma 1141 I 

Lemma |29I is applied in both deterministic and randomized algorithms in this paper. We note 
that algorithm A in Lemma [29] is deterministic if a = 0. 

For the bin packing problem with item of size at least a positive constant, our Theorem 1301 
generalizes a result in [5]. 

Theorem 30. Assume that c, rj, and k are constants. There is an 0{-^t^) queries and [jg)'^^'^' time 
randomized approximation scheme algorithm for the S{5)-bin packing problem with (c,rj,k) -related 
bins. 

Proof: Let S be the list of input items of size at least 6. It follows from Lemma [THl and 
Lemma [29l By Lemma [T9l we have a t{m,n,ji) ~ 0( ™ ^ °\"^> -' ) time algorithm such that using 

z{m,n,ji) = 0{— — ^^-^) random elements from A, it generates elements y'l < . . ■ < y'„i from the 
input list such that Pr[Rank(j/^, S) O [ih — jih, ih + jih] = for at least one i € {!,..., m}] < a. We 
assume that the m items y[,y'2, . . . , y'^ satisfy Rank(j/j', 3)0 [ih — jih, ih-\- jih] 7^ for i = 1,2, ... ,m. 
The approximation scheme follows from Lemma 1291 I 

Corollary 31 ([3]). There is an 0{j^) queries and {■^y^'^' time approximation scheme algo- 
rithm for the S{5)-bin packing problem. 

We have Theorem [32] that shows an example of NP-hard problem that has a constant time 
approximation scheme. 

Theorem 32. There is an NP-hard problem that has a constant time approximation scheme. 

Proof: It follows from Theorem [^ and Corollary [3T] I 
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8. Streaming Approximation Scheme 

In this section, we show a constant time and constant space streaming algorithm for the bin packing 
problem. For the streaming model of the bin packing problem, we output a plan to pack the items 
that have come from the input list, and the number of bins to approximate the optimal number of 
bins. Our algorithm only holds a constant number of items. Therefore, it has a constant updating 
time and constant space complexity. 

Lemma 33. There is an 0{u) updating time algorithm to select u random elements from a stream 
of input elements. 

Proof: Wc set up u positions to put the u elements. There is a counter n to count the total 
number of elements arrived. For each new arrived element a„; the j-th position uses probability — 
to replace the old element at the j-th position with the new element. For each element a^, with 
probability h-iri ■ • ■ ^^^^ ~ n' ^^ ^^ kept at each of the u positions after processing n elements. 
Therefore, we keep u-random elements from the input list. I 



A brief description of our streaming algorithm for the bin packing problem is given in section [2?T] 
Using the method of Lemma l33l we maintain a list X of 0(1) random items of large sizes from the 
input list. The list is updated after receiving every new element. The sizes of each small item is 
added into a variable si. Using the method in section l6Tl we find the approximate crucial items 
from the list X of random large items, which are the approximate i/i-th elements among the large 
items of size at least 5 for i = 1, ... ,771, where h and m are defined in equations (J16p . and ( (jlOp ). 
respectively. The algorithm described in section [5] is used to pack large items. The small items are 
filled into bins which have space left after packing large items, and some additional fresh bins. With 
the sum si of sizes of small items, we can calculate the approximate number of fresh bins to be 
needed to pack them. 

Algorithm Streaming-Bin-Packing 

Input: a positive constant e, and a streaming of items of size at least 5. 

Output: an (1 + e)-approximation. 

Steps: 

1. Let /3 := ^ and e := 6/3. 

2. Let (5 := I and 9 := 0. 

3. Let /x, ei and m are selected by equations dS]), dH), and pO)) . respectively. 

4. Let c := 77 ;= fc := 1 (classical bin packing). 

5. Let a := 1/8. 

6. Let It := Siml^MH^ where Ci is defined in Lemma [H 

7. Let v:=^ + m. 

8. Let Ar[l...M] be an array of u elements. 

9. Let X[i] := for z = 1,...,M. 

10. Let y[l...w] be an array of v elements. 

11. Let y[i] :=0 for i = !,...,«. 

12. Let n := 0. 

13. Let n>s := 0. 
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14. Let si := 0. 

15. For each new element a^ 

16. Let n := n+ 1. 

17. lfai<S 

18. then 

19. Let Si := si + a,. 

20. else 

21. Let n>s := n>s + 1- 
If n>5 < V then let y[n>5] :~ ai. 

22. For i = 1 to u, let each X\i\ take the new elements with probability ^!— 

23. If n>s > V 

24. then 

25. Output Packing-With-Many-Largc-Items(Q;,/3,n, si,n>5, 5) (see Lemma 

26. else 

27. Let (6i, . . . , &t) =Linear-Time-Packing(r7,>(p, F) (see Lemma [T5|) (each bin bi repre- 
sents a packing of items mY). 

28. For each bi with left space Ui > 6, 

29. move Ui — S (fractional)item size into bi from si, and let si = si — (ui — 6). 

30. Allocate si into fresh bins such that each bin except the last one wastes S space. 
End of Algorithm 

Theorem 34. Streaming-Bin-Packing is a single pass randomized streaming approximation scheme 
for the bin packing problem such that it has 0(1) updating time and 0(1) space, and computes an 
approximate packing solution Apx{n) with Sopt(n) < App[n) < (1 + e)Sopt(n) + 1 m {\)'^^~' time, 
where Sopt(n) is the optimal solution for the first n items in the input stream, and App(n) is an 
approximate solution for the first n items in the input stream. 

Proof: Let e be an arbitrary positive constant. Let S = j^. By Lemma |33[ we assume that u 
random elements have been selected from the input elements with size at least d > 0. We just add 
all elements with size less than S into a sum si. 

If the condition of line[23]in the algorithm Streaming-Bin-Packing is true, then the inequality (|93)) 
in Lemma [23l can be satisfied since h' = \_---~-\ ■ Furthermore, as = 0, the conditions of Lemma [23l 
are satisfied. The approximation ratio follows from Lemma B51 

Assume the condition of line [23] is not true in the rest of the proof. Let U be the set of bins for 
an (1 -f- e)-approximate solution to items of size at least S by Lemma [TOl It takes only 0{m) bins to 
pack those large items since n>^ is less than i; which is 0(rn). Therefore, we only need t = 0{m) 
bins for packing the items in Y . The final part of the algorithm fills all small items accumulated in 
si into those bins in U so that each bin has less than S left. Put all of the items less than S into 
some extra bins, and at most one of them has more than S space left. Filling the small items of size 
less than S is to let each bin except the last one waste no more than S space. This is a fractional way 
to pack small items. Since the item size is at most S, and each bin with (fractional) small items has 
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at least S space left. The fractional bin packing for adding small items can bring an non- fractional 
(regular) bin packing. A similar argument is also shown in Lemma [5TJ 

Assume that an optimal solution of a bin packing problem has two types of bins. Each of the 
first type bin contains at least one item of size S, and each of the second type bin only contains 
items of size less than 6. Let Vi be the set of first type bins, and V2 be the set of all second type 
bins. We have that \U\ < (1 + e)\Vi\. 

Case 1. If U can contain all items, we have that \U\ < (1 + e)|Vi| < (1 + e)\Vi U ^2]. 

Case 2. There is a bin beyond those in U is used. Let U' be all bins without more than S space 

left. We have that |t/'| < (]^s) — (1 + ^)l^i '-^ ^2|- Therefore, the approximate solution is at most 

(1 + 6)1^1 UT^2| + 1. 

I 



9. Sliding Window Streaming for S'((5)-Bin Packing 

A sliding window stream model for bin packing problem is to pack the most recent n items. Select 
an integer constant A that is determined by the approximation ratio and S, the least size of input 
items. The idea is to start a new session to collect some random items from the input stream after 
every j items. 

Assume that am+i, ■ • ■ , a-m+n are the last n input items in the input stream. We maintain a list 
of sets Si, . . . ,Sx such that if Si is a set of random items in {um+ji, ■ ■ ■ , a„i+„} ([m + ji, m + n] is 
called the range of Si), then the next S'(i+i)(mod a) is a set of random items in {am+ji+n, , . . . , am+n}- 
On the other hand, when the range of a set Si reaches [m + 1, ?n + n]), Si is reset to be empty and 
starts to collect the random elements from the scratch. We also set a pointer to the set Si that has 
the largest range. 

After receiving every j- items in the input stream, the set Si with the largest range will be passed 
to the next >S'i+i(mod a) if Si^s range reaches size n. The is called rotation, which makes the pointer 
to the set with the largest range according to the loop Si — >■ ^2 —)-,..., Sx-i — )• S'a — >■ 5*1. In the 
following algorithm we assume that n = (mod A). Otherwise, we replace nhy n' = \j~\ A. 

It is easy to see that n < n' < n + X. The bin packing problem for the last n items has a small 
ratio difference with that for the last n' items if the constant A is selected large enough. 

Algorithm Sliding- Window-Bin- Packing(c, 77, k, 7, 6, n) 

Input: bin types constants c, 77, and k, a positive constant 7, a streaming of items of size at least 
S, and a sliding window size n. 

Output: an (1 + 7)-approximation 
Steps: 



1. Let 



e 



7 



30- 

2. Let 6 ■- 0. 

3. Let /i, £1 and m are selected by equations dH), (|9]), and (fTO|). respectively. 

4. Let A := [if 

5. Let t := f . 

6. Create t empty sets Si, . . . , Sk to hold random elements and make them non-active. 

7. Let u :~ cim ogm ^^ ^Y^^ number of random elements in each Si according to Lemma [T9l 

8. Let hj be the range size of Sj. 

9. Start 5*1 to be active to collect random elements. 
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10. Let 5*1 hold u copies of the first element ai in the stream. 

11. For each new element a, from the input stream (i = 2, 3, . . .) 

12. For each active Sj and each of the u items a^ G Sj, 

13. replace a^ by a^ with probability — and let hi := hi + 1. 

14. Let Sj be the set with the largest range hj. 

15. Let (j/i, . . . , j/m):=Select-Crucial-Items(77i, u, Sj) (sec Lemma U^ . 

16. Let {xi, . . . , Xq) :=Pack-Large-Items(c, r], fc, B) with B = {y'^, . . . , y'J^} (See Lemma [T4)) . 

17. Let y be the cost for the packing with solution (xi, . . . , Xq). 

18. Output app :=:Packing-Convcrsion(n, y) (see Lemma [20)1 . 

19. If i = 0{m,od t) 

20. then 

21. if i < n 

22. then make S^+i) (mod t) be active, and let /i(j+i)(mod t) = 0. 

23. if i > n 

24. then let Sj hold u copies of a^ and let ft,j = 1 (reset S'j ) . 

End of Algorithm 

We have Theorem [351 that shows an example of NP-hard problem that has a constant time and 
constant space sliding window streaming approximation scheme. 

Theorem 35. Assume that c, rj, and k are constants. Let 5 be an arbitrary constant. Then Sliding- 
Window-Bin-Packing(.) is a single pass sliding window streaming randomized approximation algo- 
rithm for the S{d)-bin packing problem with {c, r] , k) -related bins that has 0{1) updating time and 
0(1) space, and computes an approximate packing solution App{.) with Sopt^ /.(n) < App{n) < 

(1 + 7)Sopt^ j,(n) in { — ) ^~' time, where Sopt^ ^.(n) is the optimal solution for the last n items 
in the input stream, and App{n) is an approximate solution for the most recent n items in the input 
stream. 

Proof: Multiple sessions of groups are generated to maintain the progress of incoming elements. 
The purpose of the choice of A at line [3] in Sliding- Window-Bin-Packing(.) is to let it satisfy that 
J < 777.(5/100 since n items needs at least m6 bins and j items needs at most j bins. This control 
is implemented in lines [12] to [23] in the algorithm Sliding- Window-Bin-Packing(.). 

Assume that the n integers in [1, n] represent the last n items from the input stream. Each of the 
A groups takes care of the list items in the range [i ■ j+j, n] for i = 0, . . . , A — 1, where j is an integer 

that moves in the loop 0^1->2->3->...^f-1^0. We keep A groups of u = ^^"'^"g" 
random elements each according to Lemma 1331 where p, is defined as the proof in Lemma [59] and 
Lemma [T^] After every j items, we start picking a new session of elements and drop the oldest 
session. 

When a set Sj holds u random elements from the last h elements for h G [n—t, n+t], where t = j. 
The approximation derived from Sj has a small difference with the optimal solution for the last n 
elements. Let Sopt^ i^{n) be the optimal solution for packing the last n items with (c, rj, fc)-related 
bins. We have that Sopt^ ,^ j,(/i) — t< Sopt^jjj^{n) < Sopt^ j^f.{h) -\-t. By Lemmas ITU UM and [501 
the algorithm outputs an (1 +7/2)-approximation for Sopt^ A:(^)- By the setting of i, we have that 
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(l-7/2)Sopt^,j j,(/i) < Sopt^^^jj^in) < (l+7/2)Sopt^,j j,(/i). Therefore, an (I + 7/2) approximation 
to Sopt^,^,.{h) is a (1 + 7) to Sopt^ ,^ ^.(n). 

I 

Theorem 36. There is an NP-hard problem that has a constant time and space sliding windows 
approximation scheme. 

Proof: It follows from Theorem [2H1 and Theorem [33 I 



9.1. Constant Time Approximation Scheme for Random Sizes 

In this section, we identify more cases of the bin packing problem with constant time approximation. 
One interesting case is that all items are random numbers in (0, 1]. 

Definition 37. Let Si , 62 and ei are positive parameters. For a list ai , . . . , a„ of input of bin packing 
problem, it has the {61, S2, ei)-property if the list ai, . . . , a„ satisfies 



■\{i : Oi < 62 and ai G {ai,. . .,a„}}| 



< €irj6i\{i : ai>Si and Oi € {ai,. . . ,a„}}|. 



Theorem 38. Let 61,62 and e are positive constants with 62 > 61. Then there is a constant 
(-T-) ^^-^ time algorithm such that if the bin packing problem with {c,rj,k) -related bins and 
{61, 62, e/ 3) -property, it gives an (1 -\- e)- approximation. 

Proof: Let ti be the cost of an optimal solution to pack those items of size at least 61 and ^2 be 
the cost of an optimal solution to pack those items of size at most 62- Let t be the cost of an optimal 
solution to pack all items in the list. Clearly, we have t>ti. 

The number of bins is at least bi = 6i\{i : Oi > 61 and a^ G {oi, . . . , a„}}| for packing those 
items of size at least 61 . The cost for packing those items of size at least 61 is at least rjbi since the 
least cost is 77 among all bins. Thus, 7761 < ti. The number of bins for packing those items of size 



at most 62 is at most 62 



■^^\{i ■■ ai < 62 and ai € {ai, . . . , a„}}| 



since at most one bin wastes 



space more than 62- The cost for packing those items of size 62 is at most 62 since 1 is the upper 
bound of the largest cost bin. 

With {-^) ~ time, we derive an (1 + |)-approximation b'^ for the items of size at least 61 by 
Theorem 1301 We have 61 < b'^ since b'^ is an approximation to the optimal solution and &i is a lower 
bound of the optimal solution for packing items of size at least 5i . The cost for the bins for packing 
those items of size at most 62 is at most 62 < fjyfoi < ^V^'i because of the (Ji,(52, e/3)-property. We 
output the approximation with cost b\ + ^"qb^. We have 

b'i + U^b[ < (l + l)fi + l(l + |)ti (note 77 <1) 

< (l + e)ti 

< (l + e)i. 

Therefore, we derive an (1 + e)-approximation for packing the input list with (c, 77, fc)-related bins. 

I 

Theorem 39. Assume that c, 77, and k are constants. Assume that a and b with a < b < c are two 
constants in [0,1]. Let e be a constant in (0,1]. Then there is a randomized constant (-) ^ <"+=' 
^77716 approximation scheme for the bin packing problem with {c,r],k) -related bins that each element 
is a random element from [a, b] . 
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Proof: Let e2 be a constant in (0, j) and will be determined later. Let ei = ^. Let Si = 52 = 
a + 62(6 — a). We prove that a list with random elements from [a, b] satisfies {61, 62, ei)-property for 
all large n with high probability. Assume that oi, . . . , a„ is a list of random elements in [a, b]. 

We note that with probability 0, a random element a^ from [a, b] is equal to a. For each random 
element a; G [a, 6], with probability pi = 1 — £2, wc have a^ > ^i. By Theorem [4l with probability 



at most Pi =.gi(|)Pi 
since pi > 2- 



ni 



\{i : Gi > 5i}\ is less than (pi — j)n elements. We note {pi — j)n > 



For each random element a^ G [a, b], with probability p2 
with probability at most P2 = 32(1)^^", we have n2 = \{i 
Assume that ni > j and 712 < 2e2'T-- 
Since e2 is a constant in (0, i), we have ^2 !i Q^ + i:(^ " 



£2, we have a^ < 52- By Theorem [5j 
flj < S2}\ is more than (1 + l)p2n ~ 2e2n. 

a). Thus, we have 



< 



< 



b-S2 
b 

b-52 



< 



< 



b-ia+\ib-a)) 
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3(6 



Assume that n is large enough such that {j^)e2n > 1. Wc have that 



-n2 



< 


S2 


C- O2 


< 
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3(6 -a) 


< 


46 




3(6 -a) 


<' 


166 




3(6 -a) 


< 




< 


ei?7(5irii, 



"2 



2e2n + 1 



£271 



where £2 is selected to be '^^^g^i, — —, 



which is less than i. 



Pi + P2, the ((5i,(52, £i)-propcrty is not satisfied. Theorem [ 



Therefore, with probability at most 
follows from Theorem [551 I 



Theorem 40. Assume that a < b are two constants in [0, 1]. Then there is a randomized constant 
(i) v^Tp7) iJTTjg approximate scheme for the bin packing problem that each element is a random 
element from [a, 6] . 

Proof: It follows from Theorem [39l I 



10. Conclusions 

This paper shows a dense hierarchy of approximation schemes for the bin packing problem which has 
a long history of research. Pursing sublinear time algorithm brings a better understanding about 
the technology of randomization, and also gives some new insights about the problems that may 
already have linear time solution. Our sublinear time algorithms are based on an adaptive random 
sampling method for the bin packing problem developed in this paper. The hierarchy approach, 
which is often used in the complexity theory, may give a new way for algorithm analysis as it gives 
more information than the worst case analysis from the classification. 
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